DOCUMENT RESUME 



ED 066 637 


AC 012 784 


AUTHOR 


Sankovsky, Ray 


TITLE 


State-of-the-Art in Vocational Rehabilitation: Report 
of a National Survey. 


INSTITUTION 


Pittsburgh Univ., Pa. Research and Training Center in 
Vocational Rehabilitation. 


SPONS AGENCY 


Social and Rehabilitation Service (DHEW) , Washington, 

D.C. 


REPORT NO 


RT-14 


PUB DATE 


Jul 69 


NOTE 


lOOp. 


EDRS PRICE 


MF-S0.65 HC-J3.29 


DESCRIPTORS 


Data Analysis; *Evaluation Methods; * Evaluation 
Techniques; Questionnaires; *Rehabilitation ; *State 
of the Art Reviews; ♦Surveys; Vocational 
Rehabilitation 



ABSTRACT 

A study designed to obtain information regarding 
vocational evaluation programs, their staff, and the vocational 
evaluation services they provide is presented. A survey questionnaire 
was constructed and distributed on a national level to facilities 
identified as having at least one full-time vocational evaluator. 

Data was analyzed with respect to total population, and separately 
with respect to each of sub- populations on selected criterion 
variables of (1) primary emphasis of the facility, (2) type of 
facility, (3) geographic location, (4) type of handicapping 
conditions served, arid (5) relationship of size of total staff to 
vocational evaluation staff. Overall findings indicate there are some 
common threads in patterns of vocational evaluation services provided 
by various types of facilities and programs identified. It is 
significant that there are differences in vocational evaluation 
services as a function of the empha'sis, location and staffing 
patterns of these facilities. Data from this study are stored on IBM 
cards . (Author/NF) 



AC 612- 066637 



% 



U.S. DEPARTMENT OF HEALTH, 
EDUCATION & WELFARE 
OFFICE OF EDUCATION 
THIS DOCUMENT HAS BEEN REPRO- 
DUCED EXACTLY AS RECEIVED FROM 
THE PERSON OR ORGANIZATION ORIG- 
INATING IT POINTS OF VIEW OR OPIN- 
IONS STATED 00 NOT NECESSARILY 
REPRESENT OFFICIAL OFFICE OF EDU- 
CATION POSITION OR POLICY 



RT-14 Report: Vol. 4, No. 10 

University of Pittsburgh 
Research and Training Center 
in Vocational Rehabilitation 



STATE-OF-THE-ART IN VOCATIONAL REHABILITATION 
REPORT OF A NATIONAL SURVEY 
(July 1969) 



Ray Sankovsky 



Principal Investigator 



FILMED FROM BEST AVAILABLE COPY 



Supported by 

Grant RT-14 from the Social & Rehabilitation Service, 
Department of Health, Education & Welfare, to the 
University of Pittsburgh, School of Education, and the 
Commonwealth of Pennsylvania, Bureau of Vocational Rehabilitation 




-J 

ii 



0 



ii 



P ATTERN S^ -OF -SERV-IC E S IN VOCATIONAL EVALUATION: 

REPORT OF A NATIONAL SURVEY 

‘ % / 

i 

ABSTRACT 



This was a study designed to obtain information regarding vocatio nal 
evaluation programs, their staff, and the vocational evaluation services they 
provide. A survey questionnaire was constructed and distributed on a national 
level to facilities "identified as having at least one full-time vocational 
evaluator. The data was analyzed with respect to the total population, a rd 
separately with respect to each of the sub-populations on the selected 
criterion variables of (1) primary emphasis of the facility, (2) type of 
facility, (3) geographic location, (4) type of handicapping conditions served, 
and (5) relationship of size of total staff to vocational evaluation staff. 
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SUMMARY 

Tha purpose of this study w Bn to provide information on selected 
characteristics of vocational evaluation programs, their staff and the services 
they provide, and some of the characteristics of the facilities that provide 
vocational evaluation services. 

A survey questionnaire was designed to obtain the desired information and 
trailed to 170 vocational rehabilitation facilities throughout tha United States. 
Each cf these facilities previously reported at least one full-time staff member 
in vocational evaluation (ARC Directory of Rahabilita cion- Facilities, 1968). 

The findings reported are based on a 66 percent return of the original 
cues tionnaire . 

Si:;t 7 - three percent of the respondents indicated vocational adjustment, 

26 percent indicated physical restoration, and 9 percent reported social and 
behavioral adjustment s s the prime emphasis of their respective facilities. 

Seventy-one percent of the total population classified themselves as 
voluntary non-profit facilities, and 29 percent indicated governmental 
facilities. 

Geographically, 28 percent of the facilities were located in region II, 
and 22 percent were located In region Y. Fifty percent of the facilities were 
distributed relatively equally among the remaining regions. 

The mean number of professional staff reported vas 42, and the mean 
number. of vocational evaluation staff reported vas slightly more than 6. 
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The findings on educational attainment revealed that approximately 75 
percent of the vocational evaluators employed had either a bachelor* 3 or .. 
master's degree. 

The educational backgrounds most frequently reported for vocational 
evaluators wars equally distributed among Rehabilitation Counseling, Psychology, 
Industrial Arts and Teaching. A mean rank of tha training or experleaca con- 
sidered most appropriate for vocational evaluators by the respondents, yielded 
the following hierarchy: Vocational Evaluation, Rehabilitation Counseling, 

Psychology, Industrial Arts, Work Experience, Teaching, Occupational Therapy, 
Personnel, Social Work, School Counseling and Sociology. 

An intellectual handicap vas the most frequently reported condition served 
by the evaluation units, followed by psychological and physical handicapping 
conditions. 

Over 50 percent of the client evaluations vera reported to he completed 
within a 3 to 3 week time interval, with the higher percentage of completions in 
a 3 to 5 week period. 

The total responses indicated that 23 percent of the clients went into a 
work adjustment program following vocational evaluation; 20 percent went, into 
training ; 16 percent went Into a transitional workshop; 12. percent went into 
direct placement; 10 percent were found not feasible for further vocational 
exploration; 7 percent went into on-the-job training; 7 percent vent into a 
terminal workshop; and 5 percent went into continued education. 

Approximately 50 percent of the respondents indicated the use of a fixed 
time interval for vocational evaluation (e.g., 4 week program); tha remaining 
half indicated an open-ended time interval. 

The actual active caseload for vocational evaluators ranged from less than 
2 clients to more than 13 clients. Over 60 percent of the distribution averaged 



between 3 and 10 clients, with a peak of 21 percent reporting 5 to 6 clients. 

The average number of evaluations per month for a unit ranged from 1 to 
more than 50. Approximately 60 percent of this distribution ranged between 1 and 
15 clients per month , with 27 percent reporting between 1 and 5 clients. 

Seventy-five percent of the facilities reported providing physical 
capacity analyses, either within or outside the facility. 

Over 90 percent of the facilities reported the use of psychological testing. 
General ability or intelligence testing was the most frequently cited, followed 
in order by aptitude testing, dexterity and performance testing, and vocational 
interest surveying. The most frequently reported time intervals for providing 
psychological testing were 1 to 3 hours and 4 to 6 hours. Each of these time 
Intervals represented 35 percent of the respondents. 

Approximately 90 percent of the respondents reported that behavioral 

c 

assessment was provided within or outside the facility. 

Approximately 70 percent reported using job analysis. The most frequent 
time interval cited for job analysis ranged between 1 and 6 hours. 

Over SO percent of the respondents reported using job samples. More than 
50 percent of these respondents indicated spending 23 0 or acre hours per client 
on job sampling. No characteristic trend was observed with respect to the 
number of job samples used. This distribution ranged from leas than 5 to more 
than 50 job samples. 

Approximately 80 percent of the respondents reported using the job tryout. 
The job tryout was reported as being predominantly used in service or. vocational 
training areas, and somewhat in other facilities and in business or Industry. 

The time used for tryouts varied considerably across a range from less than one 
day to more than 20 days. Characteristic peaks were observed at 5 to 7 days 
and again at more than 20 days. 
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Approximately 80 percent of the respondents indicated using the situational 
assessment approach. The most frequently reported time interval for situational 
assessment was 2 to 4 weeks. 

A ranking of the 5 evaluation approaches or techniques in the order that 
the respondents felt them to be most useful yielded the following hierarchy; 

Job Sample, Situational Assessment , Job Tryout, Psychological Testing and Job 
Analysis . 

Over 90 percent of the respondents indicated that work adjustment was 
provided either within or in conjunction with their facilities. 

The findings reported here reflect the trends of the total population. 
Additional analyses were performe d on the sub-populations of specific criterion 
variables. The criterion variables selected for this study were: 

1. Primary emphasis of the facility 

2. Type of facility 

3. Geographic location 

4. Type of handicapping condition served 

3. Relationship of the sire of the full- tine staff to the vocational 
evaluation staff. 

The respondents who selected a particular classification on a criterion 
variable were pooled and analysed as a sub-population. 

An edited version of the final report was distributed to the administrators 
of the rehabilitation facilities that participated in this study. 
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INTRODUCTION 

Background 

Vocational evaluation In the context of the mors generic rehabilitation 
assessment procase baa been receiving' Increased attention over the past two 
decades. This emphasis is best exemplified In the new and modified legisla- 
tion and in the additional services provided by rehabilitation facilities. 

From the standpoint of legislation, the Medical Facilities Survey and 
Construction Act of 1934 made it mandatory that any new rehabilitation facil- 
ity constructed under its auspice have included within the program a pre- 

vocatlonal activity unit. White and Redkey (1956) described this pre- 

\ T 

vocational unit aa a vocational evaluation laboratory in which the client 
performed a variety of tasks on a trial basis for some minimum period of time. 
The objective of this unit was to obtain the best estimate of a client's 

J 

vocational potential. 

The 1954 Amendments to the Vocational Rehabilitation Act (Public Law 
18-365, 1954) added impetus to the vocational evaluation movement by pro- 
viding the monies for the expansion and improvement of rehabilitation facili- 
ties and workshops. In addition, this 1934 legislation for the first time 
provided federal funds to support research, and to plan and implement new or 
Improved programs in rehabilitation. The iopact of this legislation on the 
vocational evaluation movement was reported by McCauley (1964) as significant 
for providing the development and testing of new models and techniques in 
evaluating the vocational potential of handicapped clients, beyond the tra- 
ditional approach of psychological assessment. 
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The 1965 Amendments to the Vocational Rehabilitation Act (Public Law 89-333, 
1 % 5 ) provided for an extended evaluation of the client *3 employment potential 
for a period up to a maximum of six months, with an eighteen month provision 
for the mentally retarded and certain other approved handicapping conditions. 

Prior to this 1965 legislation many potential rehabilitation clients could not 
receive services because their employment potential could not be fully evaluated. 
Hoffman ( 1967 ) noted that this 1965 legislation brought the vocational evaluator 
more intrinsically into the total rahabilltation process as the critical 
determiner of eligibility for the more severe cases. This 1965 legislation 
also provided monies for the actual construction of rehabilitation centers and 
workshops, and the improvement of workshops through: technical assistance, 

grants, training service projects, and the establishment of a National Policy 
ar.d Performance Council. 

The 1968 Amendments to the Vocational Rehabilitation Act (Public Law 90-391, 
1968) are the most recent legislation that significantly affect vocational 
evaluation. Thi3 legislation provides for a separate funding of vocational 
evaluation and work adjustment services. Federal grants to states are authorized 
to encumber ninety percent of the costs of vocational evaluation and work v 

adjustment. In addition to the special funding, the scop* of the target popu- 
lation for receiving these services is expanded by the Vocational Rehabilitation 
Amendments, 1968, Sec. 15(a) (4)P to include those: 

. . . individuals disadvantaged by reason of their youth or 
advanced age, low educational attainments, ethnic or cultural 
factors, prison or delinquency records or other conditions 
which constitute a barrier to employment. 

• /\ C3 

From the standpoint of the services being provided in rehabilitation 
facilities, vocational evaluatidn is expanding. Sixty-nine percent of the 484 
facilities listed in the Directory of Rehabilitation facilities (1968) indicated 
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j that they provide vocational services and twenty-eight percent of these facilities 

| Indicated vocational evaluation as the program of prime emphasis. 

( 

; To what can this growth and expansion of vocational evaluation services 

| he attributed? Redkey (1957) accounted for the initial movement on the basis 

l 

! of, (1) the recognition of team work as an essential criterion for the successful 

i 

J , V 

i rehabilitation of the severely disabled, and (2) the public acceptance of 

rehabilitation and the need for expanded services* It is likely, however, that 
j .. this growth and emphasis on vocational evaluation continued a a a matter of 

i 

( necessity. The expanded definition of a handicap (as noted earlier) served but 

j to Increase an already overwhelming backlog of potential rehabilitation clients. 

Nixon (1968) estimated that there now exists a backlog of over 5 million mentally 
and physically handicapped persona 0 in need of services and that this backlog is 
Increasing at the rate of 300,000 a year. The peed to provide more adequate 
1 services for these individuals has helped generate the legislation to provide 

the necessary services and monies to conduct the programs. 
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General Statement of the Problem 

.As a result of the legislation and the increased services provided by. 
rehabilitation facilities, a variety of philosophies, techniques, and methodolo- 
gies have been developed for evaluating the vocational potential of rehabilitation 

0 

clients. To complicate matters, differences exist not only with respect to the 
location at which these services are provided but also with respect to the 
3taff that provides the services. Hoed (1960) noted that vocational evaluation 
services were provided in medically oriented centers, vocationally oriented 
canters, workshops, special evaluation units and occupational therapy departments. 4 

He further indicated that the staff that provided these services Included 

-j 
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occupational therapists, industrial arts teachers, vocational counselors, ■] 
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vocational evaluators, and individuals with industrial experience. 

If any fruitful efforts are to be made in developing a more effective 
system of vocational evaluation, a basic understanding of the^ongoing effort is 
imperative. To achieve a better understanding of th-j current state of the art 
in vocational evaluation, the fundamental questions of what, where and how are 
vocational evaluation services provided must be answered. 

It was the purpose of this study to describe and analyze the patterns of 
vocational evaluation services that are being provided by a representative sample 

o 

of vocational evaluation units throughout the United States. 

Need for the Study 

The need for a comprehensive study is indicated by the discrepancy between 
the current emphasis on vocational evaluation and the paucity of literature and 
information available on vocational evaluation programs. 

After Neff (1960) reviewed the literature on vocational evaluation 
services, he reported the serious need for an accurate description of what was 
being done. He noted that perhaps more energy and effort had been expended in 
devising evaluation systems and programs than in appraising them. 

Judd (1967) in summarizing a sectional meeting at °the Vocational Evaluation 
Curriculum Development Workshop reported that Vocational Evaluation needed more 
intense exploration on an academic and national level if a more standard and 
uniform approach was to be realized. 

Nadolsky (1966) in support of a more concerted effort to understand 
vocational evaluation Indicated that the concept of Vocational Evaluation, its 
purpose, methodology, techniques and definition, still remains, nebulous. 

Gellman (1963) in the quest for improving vocational evaluation techniques 
in order to increase the dffectiveness of the rehabilitation processes observed 

•" l 



that a striking omission in professional literature on vocational rehabilitation 
was the absence of a sustained discussion of the theory or principles of voca- 



tional evaluation. 

A final justification for this study is that prior to any adequate 
evaluation of the current status of vocational evaluation there must exist a 
basic understanding of the existing program. 

Review of Relevant Literature 

History of the Vocational Assessment Process 

The history of vocational assessment had its origin in unscientific 
methodology. In primitive tribes, Campbell (1963) noted that warriors, hunters, 
or priests were selected on the basis of a variety of external factors such as : 
moon, winds, storms or physical characteristics. Moreover, the handicapped 
individual in these primitive societies was at the discretion of the cultural 
patterns. A psychological or behavioral anomaly could be considered either a 
curse or a blessing, and could result in either the destruction or the deification 
of the individual (Jaques, 1960). 

The study of phrenology marked a transition to a more systematic 
approach for evaluating vocational potential. According to this theory, 
abilities and aptitudes were localized in certain parts of the brain, and any 
overdevelopment of these centers indicated a particular talent in the respective 
area. To determine an individual's potential aptitudes, the various nodules on 
his skull were located and correlated with the talent areas they represented 
(Hilyard and Atkison, 1967). 

> >' 

The gradual realization that man's vocational destiny was not a function 
of external forces or physical characteristics but in a large part dependent on 
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his abilities, aptitudes, and desires, led to the development of a more 
scientific approach for assessing vocational potential. Among the early pioneers 
who provided the foundation for this scientific and empirical methodology were: 
Charles Darwin, who in the concept of individual differences provided the 
cornerstone for systematic study; Wilhelm Wundt, who founded the first psycho- 
logical laboratory at Lelpxlg and attempted to establish psychological lavs that 
would have the constancy of lave found in physics; Francis Gal ton, who initially 
devised ways of measuring physical and mental capacities; and NcKeen Cattell, 
who combined Wundt' 3 and Gal ton's procedures for measuring memory and sensory 
acuity in order to identify superior individuals (Cronbach, 1960). These early 
efforts were the foundation for the subsequent psychological testing and 
personnel selection movements. 

The vocational assessment process in rehabilitation had its initial focua 
on psychological testing. Gradually, however, new approaches for assessing 
the vocational potential of rehabilitation clients were sought when psychological 
tasting was not found to be an adequate assessment technique for a select portion 
of the rehabilitation population. Spurred by monies made available for research 
and demonstration, a variety of assessment approaches were explored. 

The vocational assessment process in rehabilitation has been identified 
by Moed (1960) and Naff (1966) as consisting basically of five approaches: 

1. Psychological Assessment 

2. Job Analysis Assessment 

3. Job Sample Assessment 

4 . Situational Assessment 

5. Job Tryout Assessment 

Although the vocational evaluation process Is not limited in content to 
these five techniques, they comprise in their application, the bulk of the 
vocational evaluation services provided, and for this reason the literature 
review will focus primarily on these approaches to vocational assessment. 
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Psychological Assessment 

The psychological assessment technique had its origin around the early 
1900’s in the work of Alfred Binet. Binet reported that sensory judgment was 
aot significantly related to general mental ability but that general mental 
functioning was: 

...the tendency to take and maintain a definite direction; the 
capacity to make adaptations for the purpose of attaining a 
desired end; and the power of auto-criticism (Terman, 1916, p. 45). 

These findings in turn, initiated the search for general and special 

abilities. 

In addition to tests of general and special abilities, the psychological 
assessment process expanded into tests of typical performance where the objective 
was not to assess what an individual could do, but what he did. Classified 
under tests of typical performance, Cronbach (1960) listed; interest inventories, 
personality inventories and structured observation. 

The complete history and development of the psychological assessment 
techniques has been outlined by Super and Crites (1962) . The significance of 
Cni3 movement is indicated by the over two-thousand psychological tests known 
to be in print (Boros, 1965). 

Assets and Limitations of Psychological Assessment : Several advantages for 

using the psychological assessment approach in evaluating the vocatio nal 

4 * 

potential of rehabilitation clients have been noted. 

Among the advantages of psychological testing Neff (1966) included : 

1. The minimum cost when compared to other techniques. 

2. The good reliability derived from the standardization procedure 
typically employed in developing psychometric instruments. 

3. The ease and quickness of administration and scoring. 



4. The ability of psychological tests to provide information that 
cannot typically be obtained by another psocess (i.e.-I.Q.) 

5. The use of psychological testing as a screening device to point 
up the limitations and strengths of a client, and to provide 
guidelines for the ensuing program. 

The limitations in using psychological assessment for evaluating vocational 
potential have also been enumerated. 

Walker (1957) noted that intelligence tests were limited in their 
ability to predict bow successfully an individual would use his Intelligence in 
a specific situation, since individuals of similar abilities, nevertheless 
differed in the amount of ability used. Under- and over-achievers are examples 
of this phenomenon. Fiske (1960) listed brevity of the tc:st instrument as one 
of the limitations in conventional testing. His contention was that the short 
period of time taken for testing had a minimum effect on fatigue and declining 
motivation, factors that were critical for estimating job potential.. 

Spei3er (1967) and Goldman (1961) indicated the limitations imposed on 
the handicapped population by speeded tests. An additional limitation noted by. 
these authors was "that of the characteristic norm population. Typically psycho- 
logical tests are standardized on the normal population and do not account for 
physical limitations. Providing time to complete the test beyond that which 
is prescribed would invalidate the results in relation to published norms; 
stopping the client at the appropriate time period could in turn produce frus- 
tration and would not provide an adequate picture of the client's potential. 

In line with limitations Imposed by the norm population Itself, Neff 
(1966) further indicated the ephemeral nature of the norm population in a 
dynamic and changing labor market and labor force. 

Sinick (1962) questioned the relationship between psychological testing 
and the realities of work, and indicated that a specific predictive relationship 
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between testing and successful employment had not yet been established. 

In summary , the psychological assessment approach, although hampered by 
the aforementioned limitations, has and will continue to serve as one of the 
basic assessment approaches In vocational evaluation. Although the norms on 
existing tests have not yet been adequately developed for the handicapped 
population, a step in this direction would further enhance the value of psycho- 
logical testing for vocational rehabilitation. 

Job Analysis Assessment 

The job analysis technique includes an accurate assessment of the job 
components. Including not only the motions involved and the conditions of work, 
but also the worker characteristics. Neff (1960) reported that this technique 
developed concomitantly with the psychological assessment approach but In the 
industrial segment of society, where Industrial needs called for a more concrete 
approach to assessing an individual's job capabilities. 

Blum (1956) noted that the job analysis developed along two lines: that 

of the industrial engineer whose concern was primarily with the task at hand; 
and that of the Industrial psychologist whose concern was the man in the job. 

From the task-at-hand aspect Gilbreth and Gilbretn (1917) devised a 
system of analysis that divided a task into its basic elements of motion, so 
that any task could be defined in terms of these units or their combinations. 

The extrapolation of this fractioning concept provided the systematic analysis 
of all job components Including working conditions, skills, and work characteristics. 

From the standpoint of man's elemental abilities Fleishman (1967) experi- 
mentally isolated and identified eleven psychomotor and nine physical proficiency 
factors which appeared to account for all the variance in a set of 200 tasks. 

These psychonotor factors Included: control precision, multi-limb coordination. 



14 



response orientation, reaction time, speed of arm movement, rate control, manual 
dexterity, arm-hand steadiness, and wrist-finger speed; the physical proficiency 
factors included: extent flexibility, dynamic flexibility, static strength, 

gross body coordination, gross body equilibrium and stamina. By operationally 
defining these psychomotor and physical proficiency factors a quality and 
quantity assessment could be performed on the task by means of a job analysis, 
and the vocational potential of an individual could be predicted on the basis 
of the degree of correlation between tho job factors and man's elemental abilities. 

Although the job analysis by itself is only a tool, the extension of the 
analysis to the individual worker and the ultimate matching of the critical 
elements between the job and the man provides the ultimate job-man assessment 
approach. 

There is a paucity of research literature on the job analysis, approach 
in vocational rehabilitation. Traditionally, this approach has been in industrial 
phenomenon, and only in recent years has it found application with the rehabili- 
tation population. One study in rehabilitation reported by Thompson and Pauhle 

A 

(.1963) used the methods-time-measurement approach (MTM) on job samples drawn 
from Industry. The job samples contained known elemental motions from which a 
predictive formula was developed that would assess the satisfactoriness of an 
individual's performance when compared to the performance generally accepted by 
industry . 

In a more basic research study, Chyatta and Birdsong (1967) using 



The l-mi approach, originally developed by Maynard, Sedgemerton and Schwab 
(1948), defines all production as a function of the methods used. A method 
is defined to be a sequence of motions performed in a set order. The time 
to complete any of the motions in the set or sequence is previously 
established by engineering standards and these pre-determined time intervals 
by their summation become the basis for computing the time necessary to 
complete the job. 
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Motion-Time study are in the process of studying how a person learns to perform 
a motor act from the point of verbal instruction to the point of systematic 
performance. 



Assets and Limitations of Job Analysis Assessment : Pauhle (1965) noted that the 

prime advantage of the job analysis approach was chat it provided a basic under- 
standing of the job and the map-performing it. 

Among the disadvantaged of Jqjb analysis Neff (1966) listed the atomistic 
error or the overanalysis of Jthe/job Into component elements and the failure of 
the approach to recognizeTmznan ingenuity. 

Pauhle (1965) indicated the job analysis’ limited application to manual 
and physical activities as al disadvantage. 

Finally the all-or-none characteristics of a matching procedure fails to 
provide for compensatory skills or motivation and could possibly precludes 
potential area of employment that was based solely on physical factors. 

In summary, the job analysis approach, although historically dated with 
the psychological testing movement, has not developed fully into a vocatio nal 
assessment approacn but remains more a tool of industry. The recent efforts 
cited for using the job analysis approach with the rehabilitation population ' 
have found the support of Blackman and Siperstein (1963) who advocate the use of 
job analysis for the evaluation of the mentally retarded, in light of the 
failure of other techniques to provide adequate assessment. 

Job Sample Assessment 

The job sample technique provides a work situation outside the normal 
industrial or business setting, including all or part of the operations required 
by a job, a standardized procedure for administration and scoring, and a 
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procedure for observing and rating the behavior of the performer (Graves, 1967) 
ar.d (Thompson, 1960). Xhi3 approach is an attempt to capitalize on the assets 
of both the job analysis and the psychological assessment approaches. From 
psychological assessment, the job sample adapts standardization and statistical 
rigor; from the job analysis, it derives the critical and detailed analysis. 

A1 though Neff (1966) attributed the systematic development of the job 
sample largely as a post World War II phenomenon, and primarily in the matrix of 
the rehabilitation movement, earlier attempts in ssing job samples are recorded 
in industry. 

Perhaps the first scientific attempt at a job tryout or job replica 
can be attributed to Munsterberg in the early 1900’s. While selecting streetcar 
operators for the Boston Railway Company, Nuns ter berg constructed a model street- 
car to assess potential candidates (Blum, 1956). 

Bellows (1940) described a Metal Filing Worksample that isolated one 
element of the work performed by a dentist. This job sample correlated .53 with 
the grades obtained in a course in dentistry. 

Melton (1947) and Fleishman (1956) in conducting research on the job 
sample or job replica for the Air' Force reported a series of samples including 
complex coordination, pursuit confusion, two hand coordination, rudder control 
test, and a variety of simulator devices. One such simulator provided the 
potential pilot with a "stick" and "rudder bar" which the candidate manipulated 
in response to directions indicated by a panel of flashing lights before hxm. 

The pattern of responses indicated the wculd-be-candidata ’ s potential for becoming 

if '» , 

a pilot. Xhi 3 sample yielded a validity of approximately .40 for predicting 
pilot, success. 

The development of job samples as a function of the rehabilitation 

c 

movement was reported by Graves (1967) to have its origin at the Institute for 
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the Crippled and Disabled in New York under the TOWER system, an acronym for: 
Testing, Orientation and Work Evaluation in Rehabilitation. Currently the TOWER 
has more than 110 job samples expanding over fourteen occupational families 
including: Clerical, Drafting, Drawing, Electronics Assembly, Jewelry Manu- 

facturing, Leathergoods, Lettering, Machine Shop, Mail Clerk, Optical Mechanics, 
Pantograph Engraving, Sewing Machine Operation, Welding and Workshop Assembly. 
These job samples duplicate industrial operations and consist of a series of 
te3ts graded in increasing difficulty on which standards of performance have 
been documented. Scores are based on quality and rate of performance. An 
ovarall estimate of client performance indicates the most suitable type of job 
ac tivity . 

: Tha job sampla technique has found application in the sheltered workshops. 
The leval of sophistication of most of the samples in the TOWER system, however, 
created some difficulty for a workshop population. To offset this, Affleck 
(1967) reported the development of twenty-eight job samples, based on the 
TOWTdR systara as a proto type, that would be more applicable to a workshop 

f 

population - 

Hiller (1963) outlined 3 complete work evaluation program, which included 
twenty- three samples derived mainly from the Goodwill Industries programs. 

Although various authors reported tha development of systems of job 
samples, the quest for additional job samples and systems continues. In order 
to reduce the problems encountered in developing job samples and to provide for 
a systematic procedure in obtaining job samples, Banister and Overs (1964) 
researched and reported a system for the development of job samples from industry, 
including procedures for: contacting companies, the job task trait analysis, the 

T/riting of job sample task descriptions and instructions and the norming process. 
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In addition to the programs that had been funded for the development and 
refinement of job samples, there are an unknown but perhaps significant number 
of job samples being developed and utilized throughout the many rehabilitation 
facilities and workshops in the country. 

Research literature on the effectiveness of job samples and their 
predictive validity for training or employment success has, however, been scant 
and inconclusive. Rosenberg (1967) reported a study in which a sustained effort 
\7a3 made to validate the TOWER system by studying the relationship between TOWER 
scores and ratings of performance with subsequent job placement. The overall 
conclusions reached by the author was that the true validity of the TOWER remained 
unknown. The results of the study indicated: 

1. A weak relationship between test scores on the TOWER and 
performance in a training class, 

2. TOWER scores were not related to workshop performance, 

3. TOWER scores were not related to subsequent employment, 

4. Ratings provided by instructors proved to be better 
predictors of future employment than the TOWER test scores. 

bani 3 tar and Overs (1964) reported on a follow-up study of clients who had 
beer, tasted on job samples. Of the clients tested, three-quarters entered jobs 
not related to the job sample tasks and of the remaining one-fourth who entered 
3003 related to the job sample tasks, success in some of these jobs was predicted 
better by psychological tests. 

To what extent are job samples being used in evaluating the vocational 
potential iof rehabilitation clients? Sidwell, Irelard and Koeckert (1961) 
conducted a study on the use of job samples in hospitals, rehabilitation centers, 
and workshops. They reported thirty-three percent of the total group surveyed 
(131 facilities) indicated using job samples. From this group the majority of 
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the workshops reported at least three-fourths of the total evaluation time was 
devoted to job sampling; the rehabilitation centers noted the use of job samples 
for half or less of the total evaluation time; and the hospitals reported using 
job samples for approximately one-fourth of the total evaluation time. There are 
no current estimates on the e*tent of the use of job samples in rehabilitation 
facilities and workshops. 

A33ets and Limitations of Job Sample Assessmen t: Several authors have discussed 

the advantages, limitations, and disadvantages of the job sample technique. 

Among the most notable are Jieff (1966), Banister and Overs (1964), Sakata and 
Sinick (1965) , and Sinick (1962) . The advantages cited by txiase authors for the 
job sample technique include: (1) job samples by their v6ry nature approximate 

their criteria better than the psychological assessment process; (2) the meaning- 
fulness ^of the concrete tasks tend to reduce motivational problems encountered 
so often by the abstract content of tests; (3) the job sample provides a more 
relaxed atmosphere than the typical ts3t situation reducing anxiety and providing 
a sense of security; (4) job samples yield valuable observational information 
rather than only the simple quantification of scores; (5) job samples can be 
used i/hers other methods of assessment ara not feasible- — for example, where 
reading levels are low or non-existent and with handicapping conditions such aa 
aphasia or deafness* 

Some of the limitations or disadvantages of the job samples include: 

(1) developing job samples ±3 an expensive and time consuming process; (2) valid- 
ity for the job sample approach has not been documented; (3) in the constantly 
changing pattern of the world of work, job samples tend to become obsolete; 

(4) the assessment of concreteness imposes a limitation in that it i3 an impossible 

4 

task to construct samples for all known job areas; (5) clients who are asked to 
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perform oa work tasks resembling jobs they dislike might intentionally perform 
below tr.eir capability; (6) while job samples are more realistic than psychological 
testing, they nevertheless lack the essentials of the real work setting such as 
competition, noise and odors. 

In s umm ary, the job sample approach has received considerable attention 
from the standpoint of development but lacks adequate evaluative research and 
validation. Current information on the job sampling technique for evaluating 
vocational potential indicates the movement is widespread and receives considerable 
.emphasis in rehabilitation facilitieesand workshops. However, there is little 
current information on the content of these programs. 

Situational Assessment 



Chouinard (1159) attributed to Fred Elton the pioneering effort in 
rehabilitation for the situational assessment technique. Elton's basic assumption 
was uncomplicated: in order to determine if a disabled painter would be able to 

continue his job, simply provide him with paint, a brush, a wall to paint, and 
observe. The resemblance of the situational approach to the job sample approach 
lies in the attempt to approximate actual working conditions, the difference is 
in the orientation. While the job aample attempts primarily to tap work skills 
and physical components, the situational approach places emphasis oa the 

c. 

individuals 5 work behaviors; work tolerances; attitudes toward work, employer, 
supervisor, co-workar; motivation for work; and reaction to stress and production 
pressures (Neff, 1966). 

Historically, the situational assessment approach to vocational evaluation 
in rehabilitation received its major impetus through the sheltered workshop 
movement. Gellmaa (1961) at the Vocational Adjustment Center of the Chicago 
Jewish Vocational Services is credited with the introduction of the Vocational 
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Adjustment Shop. The objectives of the adjustment shop were to increase the 
handicapped individuals' employability level through the therapeutic use of work.. 
Although the method was designed to aid handicapped clients to overcome psycho- 
social barriers that prevented them from entering competitive employment, this 
approach provided in addition a means for assessing the vocational potential of 
the more severely disabled clients in a more realistic but still highly modifiable 
work situation. The situational assessment technique is so closely linked with 
the sheltered workshop that Moed (I960) Indicated sheltered workshop work was 
a method of pre-vocatlonal evaluation. 

If the situational assessment approach has been identified primarily with 
the workshop movement, the extent of this approach can be estimated as a function 
of the workshops in existence. Lang (1967) indicated there are approximately 
1500 workshops throughout the United States and that the movement is expected 
to doubla within two years. 

Asset3 and Limitations of Situational Assessment : Fiske (1960) noted that the 

situational technique provided an individual with a work environment that was as 
lifelike as possible, and the means for appropriately assessing the individual's 

work behavior provided the rationale for predicting successful training or 

& 

employment. Other advantages cited for the situational approach are related to 
this close approximation to the actual work situation, including: wages , noise, 

odor, competition with others, industrial schedules and tools. 

The disadvantages of the situational approach stem primarily from the 
application of the theory. Ileff (1966) noted the obvious impossibility of 
replicating in the workshop the variety and levels of employment skills that 

exist in business and industry. He further commented on the low level type jobs 

i 

typically being conducted in the workshop such as unskilled assembly, packaging 



2 nd elementary operations. Neff again observed that the close approximation of 
the situational approach to the real working situation created a complicated 
mass of interrelated variables. 

A third significant limitation of the situational approach lies in the 
method of assessment. Client characteristics and behaviors are typically • docu- 
manted by ratxng scales and the reliability and validity of these rating instru- 
ments have been seriously questioned. Fiske (1960) noted that a foreman’s 
perception of a client's performance vas often based upon the foreman's reaction 
to the cliaac. Miller (1968) indicated that ratings by line foremen were - 
influenced by how well the foremen liked the client, and how well the client 
■733 accepted by others. Paulhe (1965) observed that it was difficult to determine 

whether the rating on a client *3 interpersonal traits vas a rating of the client, 

. i '• 

tne situation, or the rater. 

Attempts at establishing the validity of rating scales have not been 
successful to date. GeJ-lman (1960) reported the construction of a Scale of 
TJr.ployabiiity for Handicapped Persons at the Chicago Jewish Vocational Services. 
C-.ve of the tentative conclusions drawn from research on this scale is that the 
scale has actual usefulness for prediction on a nas3 screening level but is not 
sufficiently discriminative for individual prediction. Eoth Sitter (1967) and 
Goldstein (1963) report the development of rating scales but the validity 
studies have not yet been completed. ' 

In summary, the situational approach used to assess vocational potential 
focuses primarily upon the work personality of the individual. The theory 
behind the technique is ingrained in the workshop movement and as such is limited 
by problems of the workshop and a relatively invalid proce33 of rating the. 



individual's potential. Notwithstanding, the technique provides a more realistic 
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work setting than the work sample approach. 

Job Tryout Assessment 

The job tryout technique is perhaps the oldest of the various vocational 
assessment approaches. The individual is placed into an actual employment 
situation including: pay on a fixed or variable 3cale, competition with fellow 

employees, the construction of a product or a service provided, and the noise, 
odor9, and tools of the occupation. The assessment is for a specific job or* 
job segment and if the individual performs satisfactorily he is typically 
employed in the same or identical job situation. Although Hiller (1968) noted 

o 

that the job tryout was the least popular method of work evaluation, there is a 
growing trend as noted within industry to provide a job trial situation prior 
to any other type of evaluation. Willard (1967) reported that the Inland Steel 
Container Company hired employees before testing them. 

Xludt (1967), Manager of Personnel Development for Hughes Aerospace 
Company reported training 120 hard-core minority youth referred from social 
agencies for clerical and electronic assembly jobs disregarding test scores and 
educational level. 

The job-site, 3 term almost synonymous with the job tryout, ha3 been used 
by Bitter (1966) to describe an arrangement with cooperative employers to permit 

clients to work and train at these business or industrial settings for varying 

•*# 

periods of time in order to determine specific training objectives. 

The shop tryout, reported by Steiner (1967) called for placing a client 
into a training program for evaluation of vocational potential by the instructor 
rather than in the actual job situation. 

Ass ets and Limitations of the Job Tryout Assessment : Perhaps the most salient 
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feature of the job tryout is that it combines the objectives of the work sample 
and the situational approach into the most realistic work situation possible. 

The client 13 exposed to the tools of the trade, the language, the successful 
employees on whom the standards are based, a realistic wage and a product that, 
unlike a work sample, remains assembled. The neaningfulness of this experience 
transcends the typical work sample or situational workshop approach. 

The disadvantages of the job tryout approach are primarily linked to time 
and cost. Unless the initial job tryout Is successful, this approach has a 
tendency to consume considerable time both of the staff and- the client. Varying 
in direct relationship to time is the factor of cost. Job tryouts are typically 
conducted in the actual Industrial or business setting. Overhead, waste, and 
delays in production lines all contribute to the overall decrease la profit, 
not to mention the upkeep of the client on the tryout. 

In summary, this approach provides the most realistic setting of all the 
assessment techniques. Although it is limited by time and cost factors, it is 
gaining prominence a3 a vocational evaluation technique. 

Summary 

The various techniques « for assessing the vocational potential of rehabili- 
tation clients can be used by. any evaluation program, depending on the nature of 
the clients' handicap and the evaluation objectives. 

Vocational assessment by psychological testing has not been successful 
■with the mentally retarded or the socially and culturally deprived. Psychological 
assessment, nevertheless, finds appropxiate application with clients of average 
or above average intellectual capacity. The situational approach provides 
specific behavioral information and the Job sample approach assesses functional 
capacity most adequately. 
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If the objectives are to provide na93 screening prior to any extended 
evaluation, psychological testing i3 most appropriate. To determine if an 
individual’s work behavior is appropriate or inappropriate, the job sample or 
situational assessment would be Indicated, For the assessment of a specific 
skill the job sample appears most appropriate. To determine if an individual 
can function adequately in a specific job situation, the job tryout provides a 
method of assessment. 

Each of these techniques have evolved for the evaluation of an individual’s 
vocational potential because of a specific or general need. Each technique has 
its advantages, disadvantages and limitations; and none of them can encompass 
n 1 1 the problems encountered. 
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Statement of the Problem 

The most effective model or system of vocational assessment using the 
previously identified approaches or techniques either singly or in combination 
has yet to be empirically defined. Eventually, an evaluation of the vocational 
evaluation process will become an essential research undertaking. Prior to any 
such analysis and evaluation a basic understanding of current practice must be 
developed. The general question this study wa3 designed to answer wa9 : 

What is the current state of the art in vocational evaluation a3 
defined by the vocational evaluation services being provided in 
a representative sample of rehabilitation facilities? 

Specific Questions to be Answered 

In order to identify the services and the patterns of services provided 
in vocational evaluation the following questions were posed: 

1. What are some of the characteristxes of rehabilitation 
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facilities that provide vocational evaluation services? 

2. what are the characteristics of the vocational evaluation staff in 
rehabilitation facilities? 

3. What are the characteristics of the vocational evaluation programs 
v/ith respect to: 

a. the vocational evaluation unit 

b. the vocational evaluation services? 

4. What additional services related to vocational evaluation are 
provided by the rehabilitation facilities? 



! Scope and Limitations 

\ 

i 

! Vocational assessment cannot be considered an entity but must be thought 



of a3 an integral part of the total rehabilitation assessment process. An 



investigation of this total rehabilitation assessment, however, is beyond the 
scope of tills study. The segment of the rehabilitation process dealing with the 



methodology and technology of the vocational assessment of the rehabilitation 



population is here defined as "vocational evaluation,” and is -the content area 



Eor this study. 
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METHODOLOGY 
Type of Study 

This study can be best described as a complex sample survey (Cochran, 1963). 
From a descriptive standpoint the objective was to obtain information about the 
characteristics of a large group; from an analytic standpoint the objectives 
were to make comparisons between various subgroups of the population in order 
to identify the forces at work in the population. 
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Description of the Population 

C’aniff (1965) in the Manual of Standards for Rehabilitation Canters and 
Facilities indicated that at least one full time professionally qualified 
person should be employed by a facility in a specific area if the facility is to 
purport offering services in that area. On this basis, only those facilities 
reporting at least one professional staff member in vocational evaluation were 
included in thi3 study. 

'flic most recent source of information on rehabilitation facilities is 
the Directory of Rehabilitation Facilities (1968). This directory contains a 
.listing of 484 rehabilitation facilities in the United States and Canada, 
including information on: facility emphasi3, type of ownership, services offered, 

patients served and the professional staff. Mhile this represented only those 
facilities that responded to the Directory questionnaire (1070 were originally 
contacted), it was the best source available. Of these 484 facilities, 170 
indicated having one or more full time professional 3taff who provided vocational 
evaluation services. These 170 rehabilitation facilities comprised the population 
for this study. Included in this population were schools, hospitals, rehabilitation 
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centers, sheltered workshops and other rehabilitation facilities. 

Procedure 

The nail questionnaire was the method of survey used in this study. A 
postcard follow-up was undertaken three weeks after the mailing of the initial 
questionnaire in order to remind non-respondents. A second postcard follow-up 
wa3 conducted two weeks after the first follow-up. The origiAl planning in 
this study was not carried to completion because of the reorganization of the 
Research and Training Center, and the subsequent curtailment of the project. 

Not included in the final study was a third follow-up of non-respondents by 
personal letter and telephone. In addition, a site visit of five responding 
facilities was planned but not conducted. The purpose of the site visit was to 
confirm the reliability of the information gathered. 

I 

Questionnaire Design and Development 

S election of Variables ; As previously indicated, the focus of this study was 
on the services provided by vocational evaluation programs. In order to identify 
these characteristic services, the following two types of information were 

analysed : 

1. The standards and guideline manuals for rehabilitation 
facilities and evaluation including: the Experimental 

Evaluative Instrument Baaed on Standards for Sheltered 
Workshops , (Thompson, 1960); Standards for Rehabilitation 
Centers and Facilities , (Caniff, Pomp, and Weiner, 1965); 

Guidelines for Organization and Operation of Vocational 
Evaluation Units , (Little, 1966); and Training Guides in 
Evaluation of Vocational Potential for Vocational Rehabili- 
tation Staff , (Cundiff, Henderson, and Little, 1965). 
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2. The services reported by a number of vocational evaluation 
units, including: Minneapolis Rehabilitation Center 

(Roger Stensland, 1954); a Program for Pra-Vocational Evaluation 
(Feldman, no data); Woodrow Wilson Rehabilitation Center 
(Dickerson, no date); Hot Springs Rehabilitation Center (Cundiff, 
Henderson, and Little, 1965); Oklahoma Vocational Rehabilitation 
?re-Vocational Evaluation Unit (Cundiff, Henderson, and Little, 

1965); The Vocational Adjustment Center Program (Huthard, 1960); 
and the Pennsylvania Rehabilitation Center (Steiner, 1367). 

Cn the basis of this information the initial questionnaire on the Patterns 
of Vocational Evaluation Services was developed. The questionnaire wa9 then 
prG-te3tad on five rehabilitation facilities to identify any procedural problems, 
finally, the revised questionnaire was submitted to a Vocational Evaluation Task 
7orce for evaluation. The recommendations of the Task Force were incorporated 
into the final questionnaire (see Appendix A). 

To enhance the return of the questionnaire, the aid of the Executive 
Directors of the Association of Rehabilitation Center, Inc., the National 
Association of Sheltered Workshops, and the National Rehabilitation Association 
“..‘ere solicited in the fora of a cover letter (see Appendix B) which encouraged 
the agency directors to participate in the study. The questionnaire and cover 
Latter were mailed directly to the administrators or directors of the previously 
identified oopulation. The facility administrator va3 asked to complete a few 
initial questions. A request .was made that the remainder of the questionnaire 
ha connlated bv the suoerviaor of the vocational evaluation unit. 
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RESULTS AND DISCUSSION 



Q uestionnaire Return 

Cne-hundrad and thirteen questionnaires were returned from the original 
170 sailed. Six of the returned questionnaires were only partially completed. 
These were accompanied by a note indicating that the questionnaire was not 
appropriate for the respective program or that the program was too new to provide 
adequate information. One respondent returned an incompleted questionnaire 1 with 
a note indicating insufficient time. Another questionnaire, purportedly 
completed, was lost in the mail. 

The incomplete questionnaires and the questionnaire lost in the mail were 
not included in the return statistics. Because of the curtailment of the study 
a cutoff date was established for accepting returned questionnaires for analysis. 
-\3 of th cutoff date, fifty-five of those originally contacted did not respond 
In any form. On this b39is, 66 percent of the questionnaires were returned and 
used in the analysis. 

1 Format for Anal73ls 

la addition to the compilation of aean3, standard deviations, maximum and 
minimum scores for all continuous data, frequencies and percents were computed 
for all categorical data. Tha respective computer programs for this analysis 
wore BIT 01D Simple Data Description, and BICD 04D Alphanumeric Frequency Count, 
version of Nay 1964, Health Sciences Computer Facility, University of California, 
Los Angeles. All of the computations \iere performed by the 7090 computer at the 
University of Pittsburgh. 



9 



9 



31 

Variables Analyzed \ 

Initially, tha analysis was performed on the responses of tha total popu- 
lation. Additionally, analyses were performed on the responses of the 
sub-populations for specified criterion variables. Tha criterion variables 
selected for this study were: 

1. The primary emphasis of the facility 

2. The type of ownership of the facility. 

3. Tha geographic location of the facility 

4. The type of handicapping conditions served by the facility 

5. The relationship of the size of the full-time staff to the 
vocational evaluation staff. 

The respondents who indicated a particular classification on a criterion 
variable were pooled and analyzed as a 3ub-population. For example, with respect 
to the criterion variable ''type of facility", those facilities who were classified 
U3 ''voluntary non-profit" were separately analyzed with respect to all responses. 
Likewise , those facilities classified as ''governmental 1 ' were analyzed separately 
from the '‘Voluntary non-profit agencies." The purpose of the sub-population 
analyses was to show characteristic similarities or differences in the patterns 
of vocational evaluation servicas across these criterion variables, so that 
rehabilitation facility representatives who could specifically identify their 
status with respect to a criterion variable might be made aware of what other 
facilities who had an identical classification status were doing. Additionally, 
comparisons could be made with the total responding population. 



Li mitations 

Two cautions must be made with respect to the interpretation of the 

findings. ' 
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The breakdown into sub-populations reduced the number of observed ca 3 es 
for anv specific analysis. Although the majority of sub-populations had a 
rosoec table number of respondents included, several aub-populationa were repre- 
sented by a snail number of respondents. Whenever possible, the categories on 
the criterion variables were collapsed so as to increase the number of respondents 
for a particular analysis, la no case, however, vas an analysis conducted on a 
category of less than nine respondents. • Interpretation of the findings for the 
lass represented populations must be made with extreme caution. 

The most serious caution for interpretation rests in the use of the data. 
Thi3 was a purely descriptive gtudy. The findings that certain types of 
facilities provide characteristic vocational evaluation services do not endorse 
these services as the most appropriate. The findings subsequently reported are 
not a set of standards that should be adopted merely because they represent 
what others are doing. Hopefully they should serve as a source of information 
to those facilities who already have ah established program for vocational 
evaluation and to those facilities who anticipate establishing vocational 
evaluation services. 

Findings 

In order to facilitate a translation of the findings, the following 
alphabetic coding sy3tem has been adopted to identify the appropriate sub- 
populations for the criterion variables: 

Primary Emphasis of Facility 

A — Physical Restoration 

3 — Social and Behavioral Adjustment 

C — Vocational Adjustment 

Type of Facility 

1) — Voluntary Non-profit 

E — Governmental 
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Too graphic Location 

? — Regions 1 and 2 
G — legions 3 and A 
i! — Regions 5 and 6 
I — Regions 7, 3, and 9 

Relationship of Total ?rof 99 aional Staff to Vocational Evaluation Staff 

J — Total Staff Between 1 and 20; Vocational Evaluation Staff Between 1 and A. 

K — Total Staff Between 1 and 20; Vocational Evaluation Staff 3etween 5 and 10. 

L — Total Staff Between 21 and 60; Vocational Evaluation Staff Between 1 and A. 

it — Total Staff Between 21 and 60; Vocational Evaluation Staff Between 5 and 10. 

N — Total Staff Between 21 and 60; Vocational Evaluation Staff of 11 or More. 

0 — Total Staff of 61 or Mora; Vocational Evaluation Staff Between 5 and 10. 

Handicapping Conditions Served 

? — Ho 3 1 Rrequently Reported Handicapping Condition Served: Intellectual. 

Q — Second Most frequently Reported Handicapping Condition Served: Psychological, 

Some of the Characteristics of Rehabilitation Facilities that Provide Vocational 
Evaluation Services 

Table I presents the percentage breakdowns for- the responses to the cate- 

y 

gorical data and Table II presents the means for the continuous data with respect 
to characteristics of rehabilitation facilities that provide vocational evaluation 
services. The data ia presented in a continuous format so that core than one 

l 

variable la represented per table. The description of the variables ia presented 
ia abbreviated fom. For a more completed description of these variables see 
tha questionnaire, Appendix A. All percents have been rounded to 2 decimal 
places, and all numerical data on the continuous variables have been rounded to 
1 decimal place. On dichotomous yas-ao questions, the 7 as response ha3 been 
recorded. Because of the curtailment of the study and the time sat for 
completion, no statistical comparisons of means or percents were performed* 
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•in phagis of Facility : Sixty-three percent of the total respondents indicated 

.'ocauionai Adjustment, 26 percent indicated Physical TRestorat ion and 9 percent 



All Tablo3 are found at end of chapter. 
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Indicated Social and behavioral Adjustment as the primary emphasis of their 
facilities. 

An analysis of these responses across the sub-populations revealed only 
small differences with respect to type of facility. Regions I and II had a 



Vocational Adjustment emphasis; and Regions V and VI reported a proportionately 
higher percentage for a Vocational Adjustment emphasis (82 percent) than the 
overall average of 63 percent. 

With respect to the relationship of total- professional staff to vocational 
evaluation staff a trend wa3 noted. The larger the ratio of total staff to 
vocational evaluation .staff, the greater the emphasis reported on Physical 
Restoration. Increases in the Social and Behavioral Adjustment emphasis'’ 1 
occurred primarily with governmental facilities and facilities that had a total 
staff population of 61 or more. Those facilities reporting an intellectual 
handicapping condition as the mo3t prevalent condition served, reported 
Vocational Adjustment as their prime emphasis mere frequently (91 percent) than 
the average of the total group. 



therapy a .3 part of their program. Approximately one-fourth included speech 
and hearing therapy as -part of the services provided. 

A higher percentage of the governmental facilities reported mors physical 



tendency to b|t more evenly distributed between a Physical Restoration and 
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approximately one-hair of the total respondents Indicated physical therapy. 





oas in physical restoration services were reported across the various 



rations. The larger the ratio of total staff to vocational evaluation staff. 
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the more physical restoration services vers reported. Those facilities indicating 

an intellectual handicapping condition as the most prevalent served, reported a 

\ 

\ 

smaller percentage of physical restoration services than the average of the total 



group. Facilities reporting a psychological handicapping condition differed only 

\ 

slightly from the overall responses regarding physical restoration services. 



than 35 percent of the respondents indicated the provision of psychological and 



was reported lass frequently with governmental \ facilities, in regions VII, VIII 

and 1:1, and in facilities that indicated a relatively higher ratio of total 

\ 

professional staff to vocational evaluation staff. 



respondents indicated vocational counseling, 97 percent indicated vocational 



va3 found les3 frequently provided in voluntary non-profit facilities and more 
frequently provided in governmental facilities and facilities that served 
basically an intellectual handicapping condition. 

Type of Facility : Seventy-one percent of the total population classified them- 

selv-33 as voluntary non-profit and 29 percent indicated governmental. With 



\- 

With respect to Social and Behavioral Adjustments services provided, more 



social services, and personal adjustment counseling; sixty-two percent of the 



respondents indicated using a sheltered workshop. The response to psychological 
and social services and personal adjustment counseling was quite stable and 
consistent across the sub-populations. The use of a sheltered workshop, however. 



A 



1th rc3?ect to Vocational Adjustment services, 95 percent of the total 



evaluation > 87 percent indicated work adjustment services, 43 percent reported 
academic training, 44 percent reported technical training, and 66 percent 
indicated sheltered workshop services. In general, ^ha services of vocational 



academic trainin, 



counseling, vocational evaluation and work adjustment maintained an equal 



distribution across the sub-populations, but academic and technical training 
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respect to the prinary emphasis of the facility fchi3 ratio was reversed by those 
facilities indicating a Social and 3ehavioral Adjustment emphasis. Forty 
percent were classified as voluntary non-profit and 60 percent as governmental. 
Typically Regions III through IX reported more governmental and fewer voluntary 
non-profit facilities. Facilities reporting a small total staff (less than 20) 
characteristically tended to be voluntary non-profit agencies. As the size 
of the total staff Increased, the facilities progressively reported themselves 
nore as governmental. 

Geographic location : Twenty-eight percent of the respondents came from Region II 

and 22 percent came from Region V. Regions I and III each accounted for 7 percent 
of the respondents; Regions VI and VII each accounted for 9 percent of the 
respondents; Region IV accounted for 3 percent. Region IX for 6 percent, and 
Region VIII for 2 percent of the respondents. Since Regions II and V constitute 
50 percent of the respondents, the variance across the sub-variables would be 
characteristically represented by these regions. 

tilth respect to the sub-populations it should be noted that Region II 
represented the most frequent response for a physical restoration emphasis 
while Region V represented the most frequent response for a vocational 
adjustment emphasis. 

Staffing Patterns : Twenty-seven percent of the respondents reported a total 

staff between 1 and 20, and a vocational evaluation staff between 1 and 4. The 
next most frequent staffing pattern reported (21 percent) was a total staff 
between 21 and 60 and a vocational evaluation staff between 5 and 10. Twelve 
percent reported a total staff between 21 and 60 and a vocational evaluation 
staff between 1 and 4. Facilities with a total staff of 1 to 20 and 61 or 



37 



wore each with a vocational evaluation .staff of: 5 to 10, each account for 
10 percent of the distribution. Facilities vith a total staff of 21 to 60 and 
- 1 or r.’ore, each with a vocational evaluation staff of 11 or more accounted for 
respectively 3 percent and 7 percent of the respondents. 

Physical restoration facilities were most frequently represented by a 
vocational evaluation staff of 1 to 4. Facilities with an emphasis on social 
and behavioral adjustment characteristically reported vocational evaluation 
staffs of 5 to 10, and 11 or more. It should be noted that facilities with an 
emphasis on social and behavioral adjustment also reported larger total staffs. 

with respect to . type of facility only 6 percent of the voluntary non- 
profit facilities reported vocational evaluation staffs of more than 11, while 
41 percent of the governmental facilities reported 11 or more vocational 
evaluation staff. 

T otal .Tu~ber of Professional Staff : The mean number of total professional 

staff was 42, however, the variation among the sub-populations was significant. 
Those reporting a physical restoration emphasis had a mean staff of 45; those 
reverting social and behavior adjustment had a mean 3taff of 110; and those 
reverting vocational adjustment had a mean staff of 31. Voluntary non-profit 
facilities reported a nean staff of 27 and the governmental facilities reported 
n ma an or 73 lOCua start. 

Regions V and VI characteristically reported a nean total staff (29) 
below the mean for the total population (42). 

i 

Chara cteristics of the Vocational Evaluation Staff and the Vocational 
Evaluation Program 

Table III presents the neans for the continuous data and Table IV presents 
a percentage breakdown for the responses regarding the vocational evaluation 
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staff and the vocational evaluation program. 

Vocational ^valuation Staff : The mean number of vocational evaluation staff 

reported was .slightly more than 6. Cn the average facilities with an emphasis 
on social and behavioral adjustment employed 3.3 evaluators; facilities with an 
emphasis on vocational adjustment employed 6.3 vocational evaluators; and 
facilities with a physical restoration emphasis employed 4 vocational evaluators. 
Governmental facilities employed 9 vocational evaluators when compared to the 
4.5 evaluators per voluntary non-profit facilities. However, when a ratio of 
evaluation staff to full-time staff was established across the variables, 
facilities with a vocational adjustment emphasis and voluntary non-profit 
facilities carried a higher vocational evaluator to staff ratio than the other 
reported facilities. 

Facilities in Regions V and VI also displayed a higher ratio of vocational 
evaluators to total 3taff ratio than did the facilities in other regions. 

educational Attainment of Vocational Evaluation Staff by Ha an Number of Staff : 

Tve . overall findings indicate that approximately 73 percent of the vocational 
evaluators employed have cither a bachelors or a masters degree. Interpretation 
of these findings across the sub-populations can be misleading, in that each 
sub-population is represented by a different mean number of vocational evaluators. 

Educational Backgrounds of the Vocational Evaluation Staff : Educational 

backgrounds for the vocational evaluators appeared to he equally distributed 
basically among Rehabilitation Counseling, Psychology, Teaching and Industrial 
Arts followed in part by Occupational Therapy and Sociology. Vocational 
Evaluation and Personnel did not contribute significantly as educational 
backgrounds for vocational evaluatdrs. 



Areas of Training or Experience Considered Most Appropriate for Vocational 

i 

■■ valuators : A mean rank of the training or experience considered nost appropriate 

by the respondents for vocational evaluators yielded the following hierarchy: 
Vocational Evaluation, Rehabilitation Counseling, Psychology, Industrial Arts, 
work experience. Teaching, Occupational Therapy, Personnel, Social Work, School 
Counseling and Sociology, 

Previous Work Experience of Vocational Evaluation Staff : No characteristic 

trend in the amount of previous work experience was noted for the vocational 
evaluators. The time intervals appeared equally distributed from no work 
experience to eight years of work experience and then gradually tapered to 
twenty years of experience. 

O 

handicapping Conditions Served in Vocational Evaluation :' The intellectual 
handicapping condition was the Dost prevalent with a nean of 31 percent, 
followed by the psychological and physical handicapping conditions each with a 
naan of 24 percent. The social and sensory handicapping conditions each 
accounted for 7 percent, and the. vocational handicapping condition accounted 
for 6 percent of the variance. # 

Percentage of Client Evaluations Completed in Specified Tlse Intervals ; An 
analysis of the time needed to complete client evaluations for the tot 
revealed that 34 percent of the clients were e/aluated within the 3 to 5 week 
interval and 22 percent were evaluated in the time interval between 6 to 8 weeks. 
Only 11 percent of the clients were reported to be evaluated in less than 
2 week s. The tine intervals between 9 and 11 weeks, and 12 and 14 weeks each 
accounted for another 6 percent of the evaluations. The tine intervals between 
15 and 17 weeks, and 13 to 20 weeks each accounted for 4 percent of the client 
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evaluations .• The period of time beyond 20 weeks accounted for the remaining 
13 percent of the client evaluations. 

Uith respect to Facility Emphasis, the facilities with a Physical 
Restoration emphasis reported the shorter time intervals needed for evaluation 
while the facilities reporting a Social and Behavioral Adjustment emphasis 
indicated that 50 percent of their clients required 20 weeks or more for evaluation. 

vfith respect to Type of Facility, the governmental facilities reported 
longer periods of time for evaluation than did voluntary non-profit agencies. 

Only slight variations in time for evaluation were observed with respect 
to the regions or the two handicapping conditions served. 

Analysis of Client Distribution Following Vocational Evaluation: The total 

' • y ■ ~ — ■ 

response...ind£cata0' that 23 percent of the clients went into work adjustment 
following vocational evaluation, 20 percent went into training, 16 percent went 
in to a transitional workshop, 12 percent went into direct placement, 10 percent 
were not found feasible for further vocational exploration, 7 percent went into 
cn-the-job training and 7 percent went into a terminal workshop. A higher than 
average proportion of the clients from governmental facilities (30 percent),., 
from regions III and 17 (39 percent), and from facilities that had a total staff 
between 21 and 00 and an evaluation staff of 11 or more (36 percent) went into 
vocational training programs after evaluation. 

t'ith respect to Emphasis of the Facility, those reporting Physical 
Restoration utilized direct placement and training most frequently after evaluation; 
those reporting Social and Behavioral Adjustment utilized workshops most frequently 
after evaluation; and those reporting Vocational Adjustment utilized work 
adjustment and training most frequently after evaluation. 
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Voluntary non-profit facilitias relied more on work adjustment and the 
workshop, and the governmental facilities relied more on training and work 
.adjustment after vocational evaluation. Only slight variations were observed 
in the typical' services provided after evaluation between those facilities 
reporting intellectual and psychological handicapping conditions. 

Established Philosophy and Objectives for the Vocational Evaluation Program : 

Tour percent of the total population reported no established philosophy and 
objectives, 39 percent indicated an informally established philosophy and 
objectives, 34 percent reported a written philosophy ana objectives, and 22 
percent indicated the philosophy and objectives were available for distribution. 

Regions V and VI and those facilities with a total staff between 21 and 60 
ar.d a vocational evaluation 3taff of more than 11 reported their philosophy and 
objectives written and available for distribution more frequently. 

Vocational Evaluation Tine Interval : Approximately one-half of the respondents 

indicated a fixed time interval for vocational evaluation (e.g. 10 week program) 

and the remaining half indicated an open-ended interval. The most significant 

« 

variations from this ratio were reported by facilitias with a Social and 
behavioral Adjustment emphasis (100 percent open-ended). Governmental facilities 
(74 -percent open-ended), and facilities with a total staff of more than 60 and 
a vocational evaluation staff between 5 and 10 (32 percent open-ended). 

2 lost Frequent Time Interval Reported for Vocational Evaluations : For the total 
respondents a 3 to 5 week period was the mo3t frequently reported (33 percent), 
followed by the 6 to 8 week period (22 percent). The next most frequent time 
period was that of more than 20 weeks (15 percent). The remaining time intervals 
were relatively equally distributed. 
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Actual Activa Caseload for Evaluator? : Twenty-one percent of the respondents 

indicated an average active caseload of 5 to 6 clients per evaluator, 17 percent 
reported 3 to 4 clients, 14 percent reported 7 to 3 clients, and 12 percent- 
reported 9 to 10 clients per evaluator. The remainder appeared equally distri- 
buted among the alternatives of less than 2 clients, 11 to 12 clients, 13 to 
14 clients, 15 to 13 clients and more than 13 clients. 

Typically facilities with a physical restoration emphasis reported smaller 
active caseloads, and facilities with a social and behavioral adjustment 
emphasis reported larger active caseloads per evaluator. 

Average Humber of Evaluations Completed Per Month by Unit : Twenty-seven percent 

of the respondents indicated their evaluation program completed 1 to 5 evaluations 
per month, 13 percent reported 6 to 10 per month, 12 percent indicated 11 to 15 
per month, 3 percent indicated 16 to 20 per month, 10 percent indicated 21 to 
25 par month, 6 percent reported 26 to 30 per month, 5 percent reported 31 to 
40 per month, and 9 percent reported 41 cr more client evaluations per month. 

Facilities with a physical restoration emphasis characteristically 
reported between 1 and 10 evaluations per month. Facilities with a social and 
behavioral adjustment emphasis reported at both enci3 of the distribution, from 
1 to 10 and more than 50 clients evaluated per month. Facilities with a voca- 
tional adjustment emphasis were more closely aligned to the overall distribution. 

Voluntary non-profit facilities most frequently reported between 1 and 15 
evaluations per month while governmental facilities were continuously distributed 
over the range from 1 to 5, to more than 50 client evaluations per month. Again, 
the larger vocational evaluation staff for governmental facilities might have 
contributed to a larger total number of evaluations per facility. Facilities 
in Regions I and II tended to report fewer client evaluations than facilities 
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in the remaining regions. 

Characteristics of the Vocational Evaluation Services Provided 

Table V presents a percentage breakdown for the responses to the categorical 
data regarding the vocational evaluation services provided. 

Physical Capacity Analysis : Twenty-five percent of the facilities reported this 

service was typically not provided. Fifty-three percent indicated the service 
was typically provided within the facility. The remaining 20 percent reported 
the service provided outside the facility or in combination with the facility. 
Facilities with a physical restoration emphasis reported this service most 
frequently (89 percent) . 

Psychological Testing : Seven percent of the facilities reported that psycholo- 

gical testing was not provided. Fifty-six percent indicated thi3 service 
typically provided within the facility. Twelve percent reported the service 
provided outside the facility and 23 percent indicate the service provided 
both within and outside the facility. 



Areas of Psychological Testing Provided : General ability or intelligence testing 

was the cost frequently reported type of psychological testing (93 percent). 

1 ' 

1 Seventy-nine percent reported aptitude testing, 77 percent reported dexterity 

; and performance testing, and 72 percent reported vocational interest surveying. 

■ Average Tina Per Client Spent on Psychological Tenting : Thirty-five percent 

of the respondents indicate a 1 to 3 hour interval and another 35 percent 
reported a 4 to 6 hour interval for psychological testing. Seven percent of 
the respondents reported 7 to 9 hours and 7 percent reported 10 to 12 hours. 

A total of 7 percent Indicated using 13 or more hours for psychological testing. 

O h O 

eric: 



Voluntary non-profit facilities more frequently reported the 1 to 3 hour 
interval and governmental facilities more frequently reported the 4 to 6 hour 
interval. 

Behavioral Assessment : Twelve percent of the facilities reported they typically 

did not provide behavioral assessment. Fifty-four percent indicated that 
behavioral assessment was a service provided within the facility, 10 percent 
indicated thi3 service provided outside the facility, and 24 percent indicated 
Chi3 service wa3 provided both within and out3ide the facility. , 

Job Analysis : Thirty percent of the facilities reported that job analysis was 

typically not provided. Fifty-two percent reported this service typically 
provided within the facility, 3 percent indicated thi3 service provided 
outside the facility, and 13 percent reported this service wa9 provided both 
within and outside the facility. 

Time Spent on Job Analysis : Twenty- two percent of the respondents indicated 

no time spent on job analysis, 25 percent reported spending less than 2 hours 
and 19 percent reported spending between 3 to 6 hours on job analysis. A 
total of 10 percent reported between 7 and 14 hours, 3 percent reported between 
13 and 22 bourn, and 12 percent indicated more than 13 hours spent on job 

Job Sample ; Seventeen percent of the total respondents reported that the job 
sample was typically not provided. Seventv-fiva percent reported the job 
sample typically provided in the facility and 7 percent reported that the job 
sample was provided both within or outside the facility. The high proportion 
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■2- jo’j sampling reported within the facility was consistent across the sub- 
•* opulacions . 
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Tine Spent on the Job Sampla ; The distribution for time spent on the job 
sample ranged in intervals from leas than 2 hours to more than 30 hours, 
forty-one percent reported more than 30 hours, and 14 percent reported between 
23 to 30 hours spent on the job sample per client. The remainder was distri- 
buted evenly between lea i» than 2 hours and 19 to 22 hours. 

dumber of Job Samples Used ; The distribution Tor number of job samples used 
ranged from less than 5 to over 50 and no specific trend was observed in the 
total distribution. Eighteen percent of the respondents indicated using more 
chan 30 job samples, 17 percent indicated using 6 to 10, 13 percent reported 
using 11 to 15, 9 percent each reported using IS to 20 and 31 to 50 job samples, 
f-even percent reported using 21 to 25 job samples, 5 percent indicated 26 to 
30 and 5 percent reported using less than 5 job samples. 

Job Tryout : Twenty-two percent reported the job tryout was typically not 

provided and 57 percent indicated the job tryout typically provided within the 
facility, five percent reported the job tryout used outside the facility and 
id percent indicated the job tryout used both within and outside the facility. 

facilities in Regions VXI, VIII and IX tended to use the job tryout 
ioore frequently than facilities from other regions. 

Khar a Job Tryout is Used : The service area was the most frequently reported 

area for using the job tryout (60 percent). Forty-nine percent of the facilities 
indicated using the job tryout in vocational training areas; 36 percent indicated 
using the job tryout in industry or business; and 27 percent reported using the 
job tryout in other facilities. 

51 
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T ina Spent on Job Tryout : The distribution of the tine spent on job tryouts 

ranged from less than ofte day to nore than 20 days. The most frequently 
reported time interval was more than 20 days (25 percent) . Fourteen percent 
reported 5 to 7 days, and 10 percent indicated less than 5 days spent on the 
job tryout. The intervals of 3 to 10 days, 14 to 16 days and 17 to 20 days 
each accounted for approximately 10 percent of the respondents. 

Situational Approach ; Twenty-one percent reported that situational assessment 
W33 not typically provided. Seventy percent indicated this service wa 3 
provided within the facility. The remaining 3 percent provided the service 
both within and out3ide the facility. y 

Time Spent on the Situational Approach : Thirty-five percent reported the 2 to 

4 week period as the most frequent time interval for situational assessment, 
and 12 percent reported less than one week a3 the next most frequent time 
interval. The period of 5 to 7 weeks accounted for 10 percent of the respondents 
The remainder of the distribution was equally distributed: 8 to 10 weeks, 4 

percent; 11 to 13 weeks, 5 percent; 14 to 15 weeks, 3 percent; 17 to 19 weeks, 

1 percent; 20 to 30 weeks, 5 percent; more tnan 30 weeks, 5 percent. 

Facilities with a physical restoration emphasis were least represented by 
this approach; fifty percent of them reported no situational assessment. ' 
Conversely the facilities with an emphasis on social and behavioral adjustment 
were noat frequently represented in the longer time intervals." Fifty percent 
of these indicated a total of 17 or more weeks spent on situational assessment. 

•lack of Evaluation Approaches Considered Host Useful : An overall rank of the 

five previously described evaluation approaches or techniques yielded the 
following hierarchy as a function of the highest mean percentage.attributed 
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co a n'anber 1 rank: Job sample (26 percent), Situational approach (24 percent). 

Job tryout (20 percent) , Psychological testing (13 percent) and Job analysis 
(1 percent) . The ordar of the hierarchy was not changed when the highest 
two ranks for each category, were combined. As a function of the sub-populations, 
however, this hierarchy did not remain constant. Pacilities with a physical 
restoration emphasis reported the following order of preference: Job sample 

(25 percent). Job tryout (25 percent). Psychological testing (18 percedt) , 
Situational assessment (14 percent) and Job analysis (0 percent) . Facilities 
with a social and behavioral adjustment emphasis reported the following order: 
Situational assessment (60 percent). Psychological testing (20 percent). Job 
tryout (10 percent) , Job sample (0 percent) and Job analysis (0 percent) . 
Facilities with a vocational adjustment emphasis reported in order: Job sample 

(51 percant), Situational assessment (24 percent). Psychological testing 
(13 percent) , Job tryout (16 percent) and Job analysis (0 percent) . 

Voluntary non-profit facilities reported the following order: Situational 

assessment (27 percent) , Job sample (27 percent) , Job tryout (17 percent) , 
Psychological testing (17 percent), and Job analysis (0 percent). Governmental 
facilities reported the following hierarchy: Job tryout (26 percant), Job 

sample (23 percant) , Psychological testing (19 percent) , Situational assessment 
(16 percent) , and Job analysis (3 percent) . 



Follow-up After Vocational Evaluation : Si:cty-flve percent of the respondents 

indicated that they conducted a follow-up of clients who had been evaluated. 
In general this ratio remained constant across the sub-populations. 
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Characteristics of the Work Adjustment Program : Table VI presents the percentage 

■ 3 

breakdown for the responses to the categorical data regarding work adjustment. 
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' .'or:; Ad j us tment : Nine percent indicated work adjustment was typically not 

provided in their facilities. Seventy-eight parcant reported work adjustment 
provided within the facility and 10 percent indicated a combination of in and 
out of facility work adjustment services. 

where T "ork Adjustment is Provided : The training area was the most frequent 

locus cited for providing work adjustment (71 percent), followed by counseling 
(70 percent), workshop (57 percent), evaluation (48 percent), outside the 
facility (34 percent) , occupational therapy (21 percent) and no service 
provided (11 percent) . 



Analysts of the Open-ended Questions 

The questionnaire was highly structured. The majority of responses 
required little more than a check mark on some list of alternatives. In order 

ho provide some opportunity for the respondents to elaborate on their respective 

\ 

-fro on 3 , thu final three questions were open-ended. In/ general these questions 



oought information on changes in the vocational evaluation programs, descriptions 



of r a search or. outcome in vocational evaluation, and additional information not 






the cuestionnaire that 



ispondencs ft 



;;a3 needed for a better 



un.iara t.iruiing of the vocational evaluation process. 

The first of these questions was: 

has your approach to vocational evaluation changed significantly 
vi thin the past year? (Significant change includes serving a 
different population of clients, a' change in techniques or services 
provided or a change in objectives.). . .If yes, please describe 
briefly hov your program changed from the_old to the new. 




fifty percent of the respondents reported a* significant change in their 
program . I/hila a number of the changes noted were specifically related to a 
facility, e.q., a shift from services solely for in-patient clients to. additional 
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.:ar; ices for out-patient clients, a trend was observed in the overall responses. 

I 

The change most frequently referred to was a # shift in the nature of the handi- 
capping conditions served. Noted specifically was an increase in the services 

provide to the "severely handicapped," the "multiply handicapped," the "hard- 

0 

core unemployed," "drug addict," the "culturally disadvantaged," "welfare 
recipients," and "public school children from cooperative work-study programs 

or special classes." Additional references were madl to a change from a program 

1 

that served only specific handicapping conditions to a program that encompassed 

| 

a broader range of handicapping conditions. Concomitant with the change in th.e: 

i 1 

typical population served was the expressed concern alnd need for new programs and 

r-;. | 

procedures in order to more effectively provide appropriate rehabilitation 

i 

cervices. The following is a list of programs or procedures indicated by the 
respondents in their attempt to provide services for jthis changing rehabilitation 
;opula ; :ion: | 

Increased staff to client ratio 

'Jora counseling and small group programs 

j t - ' 

? f ore and sooner emphasis on work adjustment 

Increased use of motivation and behavior modification techniques 

j 

Increased follow-up and supportive services j 

?lore intensive individual work to assess strengths and limitations 

| 

Longer duration needed for evaluation j 

i 

Change in staff attitudes to deal with new population 

■Remedial academic programs (budgeting, groomipg, credit purchasing, etc.) 

i 

Kore u3e of social workers 

In addition to the programs or procedures noted specifically by the 
respondents that would help to better serve the changing population 8 sevaral. 



general trend3 were noted in the overall responses. A growth process wa 3 observed 
in the use of vocational evaluation approaches or techniques. In general, 
facilities that had been using one or two assessment approaches were exploring 
or using additional approaches. For example, one facility that had focused 
on the situational approach added psychological testing and job-samples; another 
facility that had focused on psychological testing incorporated job-samples 
into its program. 

In line with this general expansion trend a movement was noted toward more 
U3e of the job tryout approach and the integration of evaluation areas into 
production areas. One facility reported the development of a training services 
program which provided skilled and semi-skilled training in a variety of areas. 

The program led to a decrease in the use of job samples and an increase in the 
use of tryouts, and reported a better overall effectiveness. 

An analysis of the responses to this question would indicate that the 
vocational evaluation programs are receiving new types of handicapping condi- 
tions; there is concern about the traditional evaluation methodology for thi 3 
population; and there are attempts being made to employ or devise additional 
programs of services for- the changing population. 

The second open-ended question was: 

0 

Do you have a staff member, full or part time, involved in development, 
modification or analysis of evaluation techniques?. . .If yes, please 
describe briefly the purpose of the research and whatever outcomes are 
available. 

While thirty-five percent of the respondents indicated that they had a 3taff 
member involved in research, only a few of the respondents reported outcomes. 

An analysis of the descriptive section revealed that the majority of the 
fs ilitias utilised a vocational evaluation staff member on a part time basis in 
the development, modification or analysis of evaluation techniques. 



Where an 



/ 



If 



I 



I 

i 



! 



I 

( 

i 




51 



independent research staff was available, the research member served as a 
facilitator and advisor for research in the evaluation unit and as a liaison 
between outside agencies and the various departments within the facility. 

Approximately 25 percent of those indicating ongoing research reported 
relatively new programs with no outcomes available. Of those report* 'g specific 
areas of research, four indicated the development of new job or vors. samples from 
industry in the community; two indicated studies on the validation of Job samples; 
four indicated establishing norms for the assessment techniques; one reported the 
development of a program of teaching aids, including programmed learning, film, 
video, etc. to teach job performance and to gain insight into work adjustment; 
one indicated the development of a vocational adjustment scale, a hospital 
industrial program and research in behavior modification; one reported research 
on determining the effectiveness of short concept films for the instruction of 
handicapped students. The remaining respondents provided a generic description 
of their research efforts, such as: evaluating existing programs of services. 

One specific outcome was reported: the situational evaluation appeared more 

suitable than the job samples. However, no indication was made to the nature 
of the job samples cr the population parameters. 

ocvnral of the respondents confirmed the need for research and development 
in vocational evaluation, but further noted the prohibitive costs of research in 
service oriented facilities. 

The third open-ended question was: 

Are there any additional questions you feel might be appropriate in 

order to get a better understanding of the vocational evaluation 

process? 

Approximately twenty-rive percent of the respondents took the opportunity 
to react to thi3 question. 
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Several recommendations were made regarding the questionnaire itself. One 
respondent indicated the questionnaire did not completely describe the vocational 

*• o 

evaluation in a sheltered workshop where the client wa3 .employed and paid op a 
price rata basis. 

Thera waa some concern on our part on the length of the questionnaire (16 pages) 
however, only one respondent reported that the questionnaire was too long to be - 



effective. 



A summarization of the responses provided to this question would significantly 
reduce the feelings and meanings of the respondents. For this reason the responses 
have bean reproduced verbatim, without reference to origin. These are the needs 
reflected by the basic service providers, and perhaps they will generate some 

\ 

additional researchable questions. 

Questions regarding the size (physical plant) of the overall facility 
and of the vocational evaluation unit should be included. 

Question regarding tr.a number of rehabilitation counselors for whom 
T /a provide client evaluations. 

Question regarding recreation for our clients. 

. ricops of tha survey did not include auxiliary services, e.g., 
optical aid clinic, cardiac work classification unit, outpatient 
services such as dental, GID testing, psychological testing. 

Survey does not include any aspects of how a workshop and a 
rehabilitation center coordinate services when located within 
tha same facility and under the same administration. 

Relationship of evaluation to tha counseling process. How i3 
' evaluation used? Uho transmits information to clients? Who is 
responsible for the development of a vocational plan? 

Salarios-qualif ication of personnel in more depth. 

I would like to see some feedback from outside employment (a . g . , 
industry, etc.) relevant to predictions made in the work evaluation 
process. 

la the case of work adjustment clients having experienced evalua- 
tion; test-re test might make for inter asting data. 



A 1:30 , I'd want to know the percentage of evaluators who engage in 
professional activity outside of their jobs (a.g„, professional asso., 



The mutual exchange of professional experiences can often bring 
about modifications in practice and thinking. 

How valid and what role, if any, does a tine and notion 3tudy play 
in evaluation? 

Wa are anxious to laarn how much staffing you feel is necessary for 
a successful evaluation program, keeping in mind economic limitations. 
Ua would also like to know what other facilities have done, especially 
in the sheltered x/orkshop field, to upgrade their evaluation programs. 

You might inquire about present* educational and skill level 3 of 
clients, about what sort of placement is found most effective and 
what sort of employers or approach to then ±3 most receptive. 

Questions reflecting in-service training techniques used for increasing 
diagnostic evaluation skills of non-professional staff within facility. 

Would like to know about "favorite tests" employed by evaluators 
who baliave a particular test or technique has good predictive 
value for specific occupational areas or job goals. 

Is there a more or less optimal time duration in which a com- 
prehensive evaluation i 3 complated-re: formal work samples- 

does ona compulsively follow a standardized procedure of X no . 
of hours of testing (a3 we often do with psychometric testing) 
or can we make a determination in a much shorter period of time? 

Information gained through a questionnaire such as this may 
become more meaningful if a direct question were asked a3 to 
what part the evaluation unit played in the ‘Rehabilitation Unit 
of each facility? 



Regular seminars in evaluation philoso d be 



Why don't existing evaluation programs share ideas, methodologies, 
techniques, etc. through some recognized central distribution 
center? 

What feedback is available to indicate the value of evaluations done 
by different methods? 

How are case conferences used to relay and consolidate Work Evaluation 
findings? How do conferences promote planning? 



) 



arranged . Where and when and by whom 




You could have asked more about how writteh reports are made. Tills 
might lead to greater standardization and reporting around the country. 
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How are agencies preparing evaluation data for inclusion in IBM computer 
application, (a la Dr. ?ahle at Stanford) Our hope is to gradually 
develop the capacity to store information as a client goes through work 
evaluation then get a “print-out* 1 at the end to be amended by the evaluator 
at the conclusion of the conference and the client ? 3 stay. An application 
for a grant to do this was turned down but someone else may be able to 
work it out. 

what new innovations do evaluation departments foresee in the coining years? 

How are evaluation departments preparing for implementing Title 15 when 
it is funded? How do we do work evaluation in the ghetto where “instant” 
delivery is needed? 

As with any forced choice survey, particularly ones concerned with the 
amorphous terms and approaches used in rehabilitation facilities, biases 
are built in which often distort the validity of responses. Perhaps 
3paca could be provided after each question to allow the respondent to 
qualify his answers if for no other reason than to justify such answers 
in the niad of the respondent. 

Wh at are the stages or steps in evaluation? An initial evaluation for 
developing “work potential profile”? An extended evaluation for 
assessing progress in modifying profile and bringing clients to 
employability through work adjustment, etc.? 

’/hat are the factors that militate against employability r of clients 
at time of referral? (Categories in Question 6 have semi significance, 
but usually are not the real problems around which evaluation and other 
services are developed.) 

under what conditions does each type of vocational evaluation represent 
the “best ..fit"? Are there desirable sequences in which combinations of 
the9e approaches should be used? 

If vs accept the premise that “evaluation is a continuing process”. 

(a) How do we distinguish steps or phases as in i?l above?, (b) In what 
V3y3 does ‘*ocu3 or emphasis change in each phase? 

?/hat is the rationale underlying each tyoe of evaluation? What kinds of 
information does each type provide? 



The concept of matching personal abilities with job requirements is well 
accepted. Yet many rehab clients-low academic achievement, poorly 
developed emotions and attitudes, etc. -need special environmental 
conditions to function effectively on jots. The judgment is frequently 
made that the kind of work the person doe3 is not nearly 30 important 
as the company he works for and the supervisor he vork3 under. Would 
like to see more Information developed on emphasis of job milieu 
requirements as part of vocational evaluation. 

y,o mere questions, but man it would ‘sure be great to get some answers ! 
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. W\1U a number of tbs changes noted were specifically related' to a 
fncLILzy, e.g., a shift frnn services solely for in-patient clients to. additional 
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In addition to the programs or procedures noted specifically by the 
respondents that would help to better serve the changing population, sevaral 
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CONCLUSION 



The overall findings of this study indicate that there are some common 
threads in the patterns of vocational evaluation services provided by the. 
various types of facilities and programs identified. Kore significant, however 
are the findings that there are differences in the vocational evaluation 
services as a function of the empha3i3, location and staffing patterns of these 
facilities, while it is possible that several of these actuarial differences 
are generated by external factors (i.g., a larger staff can provide a wider 
variety of services), it i3 also possible that the differences noted are a 
function of different or unique programs of vocational evaluation. The next 
fundamental issue i3, "which of these programs or approaches in vocational 
evaluation are the most affective?' 1 The purpose of this study vas only to 

t 

identify thesa programs, hopefully, the purpose of subsequent study would be 
to Identify the effectiveness of these programs, and which, if any, contribute 



to a better overall rehabilitation assessment, 

the data from this study are stored on Ita cards. An investigator can 
r aadily sort out any aspect of the vocational evaluation process previously 

| ^ h -} £1 ^ U -? 1 1 ^ +--U ^ r> ~ XT ~ . ^ , — 

U 14 U U*J>V w CJ. V UXU.UUJ. VJ '.uubo i.av.XXXLXCD Ui, UCUI.VJ.O (.UdL aj.C L.tli-11, t - f., }, — 

istically strong with regard to that aspect. For example, once a group of 
facilities have been identified whose primary approach to vocational evaluation 
is psychological testing, a cooperative exploration of a particular test or 
series of tests among these facilities can be initiated. These facilities can 
act n*\ each other T n nomiag groups or aid in the standardization of newly 
devised tests. Likewise, facilities interested primarily in the job sample 



I 



73 



i 

i 



\ 

i 

i- 



i 

) 

» 

! 



t 



\ 

( 

i 



\ 



i 

; 



I 

I 



t 

I 

t 

I 

( 



A-: | 

• \ I 



approach, job analysis or situational assessment can become more intrinsically 
involved in developing a better vocational evaluation methodology if they can 
hs made aware of ea:ch other’s respective interests. 

It ia proposed that the data from this study be used beyond the traditional 
and static descriptive phase, to that of a dynamic on-going effort of bringing 
together facilities and centers with common interests and programs, for the 
purpose of further refining or renovating the current state of the art in 
vocational evaluation. 
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APPENDIX A 

THE PATTERNS OF VOCATIONAL EVALUATION SERVICES 

Principal Investigator: Ray Sankovsky 

Research and Training Center of the University of Pittsburgh 



i 




The purpose of this study is to describe and obtain a better under- 
standing of the vocational evaluation process in rehabilitation facilities. 

For' purposes of this questionnaire, we have defined vocational evalu- 
ation as follows: 

• Vocational evaluation - _a diagnostic process of determining actual 
or expected performance for work based on information obtained from 
one or more of the five approaches described below . 

As contrasted with: 

. Work adjustment - a therapeutic process designed to enhance an 
individual’s vocational potential by providing an increase in 
(i) physical tolerance, (2) vocational knowledge and experience, 
and/or (3) appropriate work attitudes and behaviors. 

In order to present a common basis for responding to this questionnaire — 
so that we all use the same terms the same way — we have operationally defined 
several approaches or techniques used in vocational evaluation. Please refer 
to these as needed when you answer the various questions. 

1. Psychological Testing Approach 

-to collect intellectual and behavioral information 
-by paper and pencil tests, performance tests, and clinical tests 
-to determine actual or potential intellectual or performance 
potential for work or training 

-using general ability, aptitude, achievement, dexterity, performance, 
interest, etc., measures or devices 

2. Job or Work Sample Approach 

-to collect performance information on general or specific work skills 
-by using a model or reproduction of a job or part of a job 
-to determine actual or potential performance on general work skills 
-on a job or part of a job occurring in business, trade, industrial 
or service area 

3. Situational Approach 

-observations of a client’s work behaviors and attitudes in a structured 
(but not actual) work setting under the direction of a supervisor 
-to determine work behaviors and personality 

-typically using continuous and sustained activities, e.g. , assembling, 
packaging, collating, etc. 
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4. Job Tryout Approach 

-evaluation of a client’s actual work skills on a specific job 
-in a real-work industrial, business, trade, or service operation 
with pay 

-to determine his suitability and performance using the actual 
tools of the job ' ; " \ 

-by comparing his performance to employees having the same job 

5. Job Analysis Approach 

-evaluation and description of a job or work setting 
-in a real-work industrial, business, trade or service operation 
-to determine the minimum and maximum demands (physical, emotional, 
environmental) required of a perspective employee 
-as a means of properly assigning clients meeting these demands of 
the job jto the job 



Instructions for Completion 

1. Items 1-5 should be completed by the facility administrator. 

2. All other items should be completed by the Supervisor of Vocational 

Evaluation. ,>/ 

«v vl 

3. Please mark the responses wi tl^ an X. 

4. Please complete the questionnaire as accurately as you can. 

5. Please mail the completed questionnaire in the enclosed self-addressed 
stamped envelope. All responding facilities will receive a copy of 
the results. 

Please complete the questionnaire and return within two weeks. Many thanks 
for your help. 




NAME OF FACILITY 

Please Print 

ADDRESS : 

City State Zip Code 

( ADMINISTRATOR ; 

V . Please Print 

EVALUATOR ' 

(Individual who completes the questionnaire) Please Print 

The information obtained by this survey will be kept confidential, and used 
for research purposes only. 
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Section I: Information on Your Facility 



1. Please rank in order from (1) for most to (3) for least the prime 
emphasis of your facility: 

1. Physical restoration (to upgrade physical functioning 

through a variety of medically related services) 

2. Social and behavioral adjustment (to identify and help 

resolve problems in social living through a variety of 
psychological and social services) 

3. Vocational adjustment (to help overcome unemployment , 

through a^variety of services including counseling, 
evaluation, ^training and education, placement, referral 
and sustained follow-up) 



In order to meet its objectives, a variety of services and programs 
are available in a rehabilitation facility. No single facility or 
program can be expected to serve all the problems encountered in 
rehabilitation; for this reason the patterns of services vary with 
the established objectives, availability of staff, etc. For each of 
the previously described objectives please indicate the general 
types of services your facility provides. (Check those that are 
appropriate.) 

A. Physical Restoration 



1 . 

2 . 

3. 

4. 

5. 



Physical therapy 
Occupational therapy 
Physical Medicipe and Rehabilitation 
Recreation therapy 

Specify other 



B. Social and Behavioral Adjustment 



1 . 
2 . 

3. 

4. 

5. 



Psychological services (personality assessment, etc.) 
Social services (family contacts, etc.) 

Sheltered workshop 

Personal adjustment counseling 

Specify other 



C. Vocational Adjustment 



O 

ERIC 



3. 





1 . 


Vocational counseling 




2. 


Vocational evaluation 




3. 


Work adjustment 




4. 


Academic training 




5. 


Technical training 




6 . 


Sheltered wuit 




7. 


, Specify other 


How 


would 


you classify your faciiny 


1 . 




Voluntary non-profit 


2. 




Governmental 



(Check only one.) 



Please go on to 7 the next page. 
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4, Please check the region in which your facility is located. 

Region I: Conn., Me., N.H., R.I., Vt.> Mass. 

Region II: Del., N.J., N.Y., Penna. 

Region III: D.C., Ky., Md., N.C., Va., W.Va., Puerto 

Rico, Virgin Islands # 

Region IV:- Ala., Fla., Ga., Miss., S.C., Tenn. 

Region V: 111., Ind., Mich., 0., Wis. 

Region VI: la., Kan., Minn*, Mo., Neb., N.D., S.D. 

Region VII: Ark., La., N.M., Okla., Tex. 

Region VIII: Col., Idaho, Mon., Utah, Wyo. 

Region IX: Alaska, Ariz., Calif., Hawaii, Nev., Oreg,, 

Wash. , Guam 

5. What is the total number of professional staff employed throughout 
your facility (full-time staff and the summation of part-time staff)? 
Include physicians, registered nurses, occupational and physical 
therapists, psychiatrists, social workers, psychologists, speech 
pathologists and audiologists, vocational evaluators, rehabilitation 
counselors, academic and technical instructors, administrators.... 

(Do not include clerical and maintenance staff.) 
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Section II: Information Concerning Vocational Evaluation Staff and the 

Vocational Evalua tion Unit 



6. . Please indicate the approximate percent of the handicapping conditions 
yout evaluation unit typically serves for each of the major categories 
below: (Indicate only primary handicapping conditions.) 



1 . 

2 . 

3. 

4. 

5. 

6 . 



% Intellectual (learning disabilities, mentally retarded...) 

% Psychological (neurotics, psychotics, character disorders, 
emotional disorders...) 

% Social (alcoholics, drug addicts, delinquents, minority 
groups, older workers, culturally disadvantaged, 
public offenders...) 

% Vocational (inadequate work histories, poor work habits, 
poor job finding skills ... ) 

% r Physical (severe and moderate physical problems or 

residuals-for example: stroke, congenital malformations, 

amputations, neurological, cardiac. . .) 

% Sensory (hearing, vision, speech) 



Total: 100% - 



7. Please indicate the number of your vocational evaluation staff that 
have the ^following level of educational attainment: (List only the 

highest classification for each member.) 



1. 


Masters degree or above 


2. 


Bachelors degree 


3. 


At least two years of college 


4 ; 


High school graduate plus special training 


5.: 


HiRh school graduate 


6. 


Did not complete high school 


7. 


Total number of vocational evaluation staff 

■ — H — > 0 a 
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Please indicate the number of your vocational evaluation staff 
have the following types of educational backgrounds: (Please 

indicate only the major background area for each member.) 


i. 


Industrial arts 


2. 


Rehabilitat ion counse 1 ing 


3. 


Voca t iona 1 eva 1 ua tion 


4. 


Psychology 


5. 


Occupational therapy 


6. 


Sociology 


7. 


Personnel 


8. 


Teaching (technical, trade, high school) 


9. 


Social work 


10. 


School counseling 


11. 


None of the above 



9. Please indicate the amount of work experience of your staff prior to 
beginning their work in vocational evaluation: (Indicate the number 

of staff for each category.) 



i. 


No work experience 


2. 


Less thar 2 years 


3. 


Between and 5 years 


4. 


Between 6 and 8 years 


5. 


Between 9 and 11 years 


6. 


Between 12 and 14 years 


7. 


Between 15 and 17 years 


8. 


Between 18 and 20 years 


9. 


More than 20 years 



10. Based on your past experience, please rank in order from highest 
(No. 1) to lowest (No. 11) the areas of training or experience 
you feel are the most appropriate for vocational evaluation. 



1 . 


Industrial arts 


2. 


Rehabilitation counseling 


3. 


Psychology 


4. 


Occupational therapy 


5. 


Sociology 


6 . 


Personnel 


7. 


Teaching (technical, trade, high school) 


8. 


Work experience 


9. 


Vocational evaluation 


10. 


Social work 


11. 


School counseling 



11. Have the philosophy and objectives of your evaluation program been 
established? (Check only one.) 



1. 


No 




2. 


* Yes, 


informally 


3. 


Yes, 


written 


4. 


Yes, 


available for distribution 




Please go on to the next page. 
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12. Please check those objectives listed below that your vocational 

evaluation program has established either in writing or informally. 
(The means for attaining these objectives are not limited ter the 
vocational evaluation unit proper, but can be implemented by any 
department or unit within the facility, or by purchasing services 
or programs from other facilities.) 



1. 


To 


evaluate 


the 


clients 1 


general ability (intelligence) 


2. 


To 


evaluate 


the 


cl ients ' 


aptitudes 


3. 


To 


evaluate 


the 


clients ' 


interests 


4. 


To 


evaluate 


the 


clients 1 


dexterities 


5. 


To 


evaluate 


the 


clients ' 


personality 


6. 


To 


evaluate 


the 


clients 1 


present work skills 


7. 


To 


evaluate 


the 


clients ' 


physical capacities 


8. 


To 


evaluate 


the 


clients 1 


social skills and behavior 


9. 


To 


evaluate 


the 


clients ' 


work behavior 



13. Although vocational evaluation services are designed to meet the 

needs of the individual client, many programs have some typical 
phase or time interval. Is your vocational evaluation program 
typically conducted on: (Please check only one.) 

1. An established time interval, such as a three-week program, 

a ten-week program, a two month program. . . 

2. An open-ended time interval that varies for different 

clients 

14. Does your vocational evaluation program typically use: (Please 

check only one.) 

1. A standard procedure in which each client goes through 

an established sequence, e.g., psychological testing, 
job samples, tryouts... 

2. A variable procedure in which each client has a program 

developed separately 

15. Recognizing that the evaluation of a client's potential is dependent 

on many factors and that the time element may vary for most clients, 
what percentage of the clients in your vocational evaluation program 
have their services completed within each of the following time 
categories: (Indicate a percentage for each of the appropriate 

categories.) 



i. 


7. 


Less than 2 weeks 


2. 


7. 


Between 3 to 5 weeks 


3. 


% 


Between 6 to 8 weeks 


4. 


% 


Between 9 to 11 weeks 


5. 


% 


Between 12 to 14 weeks 


6. 


7. 


Between 15 to 17 weeks 


7. 


7. 


Between 18 to 20 weeks 


8. 


7. 


More than 20 weeks 



Total: 100% 



O 




Please go on to the next page 
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16. What is the average active caseload for a vocational evaluator in 

your program? (Active means the total number of clients undergoing 
evaluation 7 at one time.) (Check only one.) 



1. 


Less than twd clients 


2. 


Three to four clients 


3. 


Five to six clients 


4. 


Seven to eight clients 


5. 


Nine to ten clients 


6. 


Eleven to twelve clients 


7. 


Thirteen to fourteen clients 


8. 


Fifteen to eighteen clients 


9. 


More than eighteen clients 



17. What in your estimation should be the ideal active caseload for a 
vocational evaluator? (Active means the total number of clients 
undergoing evaluation at one time.) (Check only one.) 



i. 


Lers than two clients 


2. 


Three to four clients 


3. 


Five to six clients 


4. 


Seven to eight clients 


5. 


Nine to ten clients 


6. 


Eleven to twelve clients 


7. 


Thirteen to fourteen clients 


8. 


Fifteen to eighteen clients 


9. 


More than eighteen clients 



IS. On the average, how many evaluations are completed in your program 
per month? (Check only one.) 



i. 


One to five clients 


2. 


Six to ten clients 


3. 


Eleven to fifteen clients 


4. 


Sixteen to twenty clients 


5. 


Twenty-one to twenty-five clients 


6. 


Twenty-six to thirty clients 


7. 


Thirty-one to forty clients 


8. 


Forty-one to fifty clients 


9. 


More than fifty clients 



19. What kind of information regarding the client would you prefer to 
have, but typically do not have , prior to beginning the client’s 
evaluation? (Check all those that are appropriate*) 

We prefer to have: 

No client information 
Social and family background 

Past educational records (transcripts of elementary or 
•high school, military training, trade or technical 
schools . . . ) 

A chronological record of past work history 
Results of medical and specialist examinations 
Intellectual, aptitude, interest, dexterity testing 
Personality and behavioral assessment or testing 
Please specify other ^ ' 
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1. 

2 . 

3. 



4. 

5. 

6 . 

7. 

8 . 
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20 . 



21 . 



Is a physical capacity analysis (including a systematic evaluation 
of the client's physical functioning: walking, running, stooping... 

range of motion, lifting, carrying...) conducted in conjunction with 
specific job objectives, e.g., a physical capacity analysis of a 
hemiplegic to evaluate his physical potential to function as a 
janitor? (Check only one.) 



1 . 

2 . 



3. 

4. 



Typically not provided for our clients 
Typically provided by either our vocational evaluation 
unit or by a department within our facility, e.g., 
occupational therapy 
Typically provided by an outside agency 
Provided by both our facility and an outside agency 



To what extent is a physical capacity analysis provided for clients? 
(Check only one.) 



1 . 

2 . 

3. 

4. 



Seldom or never 
Occasionally 
Usually 
Routinely 



22. Is psychological testing including: general ability, dexterity 

performance, aptitude achievement and vocational interest, but not 
personality assessment: (Check only one.) 



1. 

2 . 

3. 

4. 



Typically not provided for our clients 
Typically provided by either our vocational evaluation 
unit or by a department within our facility 
Typically provided by an outside agency 
Provided by both our facility and an outside agency 



23. Is personality and behavioral testing or assessment: (Check only one.) 



24. 



25. 
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1. 

2 . 

3. 

4. 



Typically not provided for our clients 
Typically provided by either our vocational evaluation 
unit or by a department within our facility 
Typically provided by an outside agency 
Provided by both our facility and an outside agency 



Please check those areas of psychological testing that your clients 
typically receive. 



1. 

2 . 

3. 

4. 

5. 

6 . 



No psychological testing is provided 
General ability (intelligence) 
Dexterity and performance 
Personality and behavioral assessment 
Aptitude 

Vocational interest 



Recognizing that the amount of psychological testing per client 
varies, on the average how much time per client is spent on 
psychological testing: (Check only one.) 



1 . 

2 . 



None 

Less than 1 hour 



Please go on to the next page. 
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3. 

4. 

5. 

6 . 

7. 

8 . 

9. 



Between l.hour to 3 hours 
Between 4 hours to 6 hours 
Between 7 hours to 9 hours 
Between 10 hours to 12 hours 
Between 13 hours to 15 hours 
Between 16 hours to 20 hours 
More than 20 hours (please specify* 



_hours) 



For Questions 26 and 27 

The job analysis approach, as used in the Dictionary of Occupational 
Titles , describes the characteristics of jobs so that the job can be 
matched to the man with the appropriate attributes. Some facilities 
do their own job analysis in local industrial or business settings, 
as a means of mote precisely matching a handicapped person and a 
particular job. With this in mind, please answer questions 26 and 
27. 



26, 



27, 



Is the job analysis approach or components of it: (Check only one.) 



1 . 

2 . 

3. 

4. 



Typically not provided for our clients 
Typically provided by either our vocational evaluation 
unit or by a department within our facility 
Typically provided by an outside agency 
Provided by both our facility and an outside agency 



In the typical client's evaluation program approximately how much 
time is spent on the job analysis approach or segments of it? 
(Check only one.) 



1 . 


None 


2. 


Less than 2 hours - 


3. 


Between 3 to 6 hours 


4. 


Between 7 to 10 hours 


5. 


Between 11 to 14 hours 


6. 


Between 15 to 18 hours 


7. 


Between 19 to 22 hours 


8. 


Between 23 to 30 hours 


9. 


More than 30 hours (please 



hours) 



For Questions 28 to 32 

Job and work samples are models or reproductions of jobs or parts 
of a job that occur eithdr specifically or generally in an industrial 
business or trade area; they often include the tools of the trade 
and the standards and norms associated with that job, e.g., 
assembling nuts and bolts, assembling and disassembling a gasoline 
motor. 

28. Is either the job or work sample approach: 



ERIC 



1, 

2 . 

3. 

4. 



Typically not provided for our clients 
Typically provided by either our vocational evaluation 
program or by a department within our facility 
Typically provided by an outside agency 
Provided by both our : facility and an outside agency 

One half completed - please go on to the next page. 
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29. In a typical client's evaluation program, on the average bow much 
time is spent on job or work samples? (Check only one.) 

I 

1. None 

2. ___ Less than 2 hours 

3. Between 3 to 6 hours 

4. Between 7 to 10 hours 

5. ____ Between 11 to 14 hours 

6. _____ Between 15 to 18 hours 

7. Between 19 to 22 hours 

8. _____ Between 23 to 30 hours 

9. ___ More than 30 hours (please specify- hours) 

30. What kind of job or work samples does your vocational evaluation 
program use? 

1. None 

2. Job or work samples that were developed and standardized 

in our unit 

3 . > _____ A standardized system or collection of job or work 

samples (e.g.» TOWER) 

• N 

31. How many job or work samples does your program have and use in the 
evaluation process? (Check only one.) 



1 . 


None 






2. 


Less than 5 




3. 


Be tween 


6 and 1 


L0 


4. 


Between 


11 and 


15 


5. 


Between 


16 and 


20 


6. 


Between 


21 and 


25 


7. 


Between 


26 and 


30 


8. 


Between 


31 and 


50 


9. 


Over 50 







32. In using your job or work samples do you generally: 

1. Evaluate for specific job areas 

2. ' Evaluate for occupational areas 

For Questions 33 to 35 

The job or shop tryout approach involves placing the client into 
an actual industrial business or trade work or training environment 
under the guidance of a foreman, supervisor or instructor to 
determine the client's present skills or potential skills for work 
in that area. 

33. The job or shop tryout, is: (Check only one.) 

1. ' Typically not provided for our clients 

2. _____ Typically provided by either our vocational evaluation 

unit or by a department within our facility 

3. typically provided by an outside agency 

4. Provided by both our facility and an outside agency 




V ; 






Please go on to the next page. 
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34. Where do you use the job or shop tryout as part of your vocational 
evaluation program? 



1 . 



3. 

4. 

5. 

6 . 



We do not use the job or shop tryout 

In the service areas in our facility (kitchen, laundry, 
maintenance...) 

In vocational training areas in our facility 
In other rehabilitation or related facilities 
In industrial or business settings 

Specify other ; 



35. 



Recognizing that all clients in an evaluation program do not receive 
a job or shop tryout; for those that do, what amount of time is spent 
on the average on a job or shoo tryout in your program? (Check only 
one . ) 



1. 

2 . 

3. 

4. 

5. 

6 . 

7. 

8 . 

9. 



None 

Less than 1 day 

Between 2 and 4 days 

Between 5 and 7 days 

Between 8 and 10 days 

Between 11 and 13 days 

Between 14 and 16 days 

Between 17 and 20 days 

Mote than 20 days (please specify time- 



_days) 



For Questions 36 and 37 

The situational approach involves placing the client in a work 
environment that has some of the characteristics of a competitive 
employment situation, e.g., time schedules, production rate, wages, 
noise, etc. The location of the work environment, however, in the 
situational approach is for the most part not commercially oriented 
and the type of work is often routine, e.g., assembling, packaging, 
folding, collating, etc. The prime evaluation objective of the 
situational approach is to evaluate the client's work behaviors 
and work personality. The situational approach has as another 
major objective, the provision of work 5 adj qstment. In considering 
the situational approach in the following series of questions do not 
include the work adjustment component. 

36. The situational approach is: (Check only one.) 



V 

3. 

4. 



Typically not provided for our clients 
Typically provided by either our vocational evaluation 
unit or by a department within our facility 
Typically provided by an outside agency 
Provided by both our facility and an outside agency 



37. 



What amount of time of a typical client's evaluation program is 
spent on the situational approach (Note: the evaluation of his work 
behaviors and not the worr adjustment component)? (Check only one.) 



O 
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1. 

2 . 

3. 



None 

Less than 1 week 
Between 2 to 4 weeks 



yo 
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4 . 


Between 


5 to 7 weeks 


5. 


Between 


8 to 10 weeks 


6. 


Between 


11 to 13 weeks 


7. 


Between 


14 to 16 weeks 


8. 


Between 


17 to 19 weeks 


9. 


Between 


20 to 30 weeks 


10 . 


More than 30 weeks (pi 



weeks) 



38. Please rank the following vocational evaluation approaches in the 

order you feel they best contribute to an overall evaluation program. 
(1 for most significant to 5 for le?st significant) 



1 . 

2 . 

3. 

4. 

5. 



Situational approach 
Psychological testing approach 
Job analysis approach 
Job sample approach 
Job tryout approach 



i 




Section III; Information Concerning Services Provided to Clients in 
Addition to the Vocational Evaluation Program 

39. Work adjustment has been defined in the introduction as a therapeutic 

process designed to enhance an individual's vocational potential by 
providing for: (1) the development of physical tolerances and 

capacity; (2) information and experience; or (3) a modification of 
inappropriate work behaviors. 

A work adjustment program is: (Check only one.) 

1. ' Typically not provided for our clients 

2. _____ Typically provided by either our vocational evaluation 

unit or by a department within our facility 
'j. ______ Typically provided by an outside agency 

4. Provided by both our facility and an outside agency 

40. What types of work adjustment are provided in your program? (Check 

those appropriate.) \ 

4 /' 

1. _____ There is no work adjustment program 

2. _____ Developing the individual's physical potential (e.g., 

physical work tolerance, accuracy and speed, 
independent living...) 

3. Providing information (e.g., job readiness, remedial 

education, occupational information...) 

4. Providing experience (e.g., exposing habilitation clients 

to a work environment...) 

5. Modifying work behavior (e.g., breaking habits of tardiness, 

increasing concentration...) 

41. Where do you do work adjustment in your facility? (Check those that 
are appropriate.) 

1. , • We do not have a work adjustment program 

2. Workshop 

3* ______ Counseling 




Please go on to the next page. 
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4. 


Evaluation unit 


5. 


Occupational therapy 


6 . 


Training areas or work stations within the facility 


7. 


In job settings outside the facility 


8. 


Specify other 



42. Upon completion of their evaluation program, what percentage of the 
clients move into the following areas: (Indicate a % for each 

appropriate category.) 



1 % 

2 . % 

3. % 

4. % 

5. % 

6 . % 

7. % 

8 . % 



Total: 100% 



43. Does your 
have been 



Direct placement 

Training (vocational or trade) 

Continued education (high school, college...) 
Workshop (transitional) 

Workshop (terminal) 

On the job training 

Not feasible for rehabilitation 

Work adjustment 



facility routinely conduct a follow-up of the clients that 
evaluated? 



1. No 

2. Yes 



44. Is a feedback of follow-up information on clients you have evaluated 
provided to your vocational evaluation program? 

1. No 

2. Yes 
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45. Has your approach to vocational evaluation changed significantly 
within the past year? (Significant change includes serving a 
different population of clients, a change in techniques or services 
provided or a change in objectives.) 

1. No 

2. Yes 

If Yes, please describe briefly how your program changed from the 
old to the new. (Use additional paper if necessary.) 
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46, Do you have a staff member full or part-time involved in development, 
modification or analysis of evaluation techniques? 

1. No 

2. Yes 

If Yes, please describe briefly the purpose of the research and 
whatever outcomes are available. 
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47. Are there any additional questions you feel might be appropriate in 
order to get a better understanding of the vocational evaluation 
process? 



1. No 

2. Yes 

If Yes, please indicate these below. 



Finished! Thanks for your help. 
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RESEARCH AND TRAINING CENTER IN VOCATIONAL REHABILITATION 

I '.NIVKUMl f'V OK I’lTTHII' MOM . 737 <!OI 'CIIHII MTHKKT . JOHNSTOWN, PKN NSYIAV, NI.N 1,1! 1 0,1 . |>| IONK IHM) IMI-lllia 



Dear Agency Director: 

The enclosed questionnaire is being selectively distributed to a 
number of rehabilitation facilities. We would like to urge your 
cooperation in providing the information requested. 

This survey, conducted by the Research and Training Center of the 
University of Pittsburgh, will provide the necessary data to make 
a nationwide assessment of vocational evaluation practices and 
me thods. 

The results of this important survey will be circulated to partici- 
pating facilities. 

We encourage you to complete the questionnaire as soon as possible, 
and return it to the Research and Training Center. 

Thank you for your cooperation. 

Sincerely, 



C. 

C. L. Roberts 
Executive Director 
Association of Rehabilitation 
Centers, Incorporated 



A, C. fuaao^ 

Executive Director 
National Association of 
Sheltered Workshops 



Executive Director 
National Rehabilitation 
Association 
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